Display control apparatus, display control method and display control program

ABSTRACT

A display control apparatus includes: a display section; a detecting section which detects an indication manipulation for a manipulation surface; and a control section which detects, if the indication manipulation for the manipulation surface is detected by the detecting section, an area in the manipulation surface indicated through the indication manipulation, and enlarges an image on the basis of the detected area to be displayed on the display section.

This application is a continuation of U.S. patent application Ser. No.12/980,592 (filed on Dec. 29, 2010), which claims priority to JapanesePriority Application No. 2010-002132 (filed on Jan. 7, 2010), which areall hereby incorporated by reference in their entirety.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a display control apparatus, a displaycontrol method and a display control program which are appropriatelyapplied to a mobile terminal having a touch panel installed in it, forexample.

2. Description of the Related Art

In the related art, an electronic device has an electrostatic capacitivetouch sensor installed in a front area of a display section, forexample. The electronic device detects the presence or absence of touchor proximity of manipulation indication means (a finger or a stylus orthe like) to the touch sensor according to change in electrostaticcapacitance of the touch sensor.

Further, the electronic device detects distance between the touch sensorand the manipulation indication means on the basis of the change in theelectrostatic capacitance of the touch sensor if the manipulationindication means moves close to the touch sensor in a state where aplurality of indication items is displayed in the display section.

Further, when the manipulation indication means is close to the touchsensor by a first distance, the electronic device calculates theposition of the manipulation indication means over the touch sensor onthe basis of the first distance, and selects an indication item which isclosest to the manipulation indication means on the basis of thecalculation result.

Then, if the distance between the touch sensor and the manipulationindication means becomes a second distance shorter than the firstdistance, the electronic device enlarges the selected indication itemand displays it on a full screen of the display section.

In this state, if the manipulation indication means is in touch with thetouch sensor, the electronic device recognizes that a commandcorresponding to the enlarged and displayed indication item is input.

In this way, the electronic device allows the indication item displayedon the display section to be easily indicated and allows the commandcorresponding to the indication item to be easily input (for example,refer to Japanese Unexamined Patent Application Publication No.2009-116583, pp 7-9, FIGS. 4 and 5).

SUMMARY OF THE INVENTION

However, in the electronic device having such a configuration, asdescribed above, any indication item in an image is enlarged at apredetermined single enlargement ratio and displayed on the displaysection, according to the manipulation for the touch sensor.

Thus, in a case where a desired portion is enlarged and displayedregardless of whether the indication item of the image is present orabsent on the display section, and the image is desired to be enlargedat a desired enlargement ratio to be displayed, it is difficult toenlarge and display the image in accordance with such a desire, therebylowering usability.

Accordingly, it is desirable to provide a display control apparatus, adisplay control method and a display control program which can enhanceusability.

According to an embodiment of the present invention, there are provideda display control apparatus, a display control method and a displaycontrol program in which if an indication manipulation for amanipulation surface is detected, an area in the manipulation surfaceindicated through the indication manipulation is detected, and an imageis enlarged on the basis of the detected area to be displayed on adisplay section.

According to the embodiment, it is possible to easily select anenlargement target portion of the image or the enlargement ratio byperforming the indication manipulation so as to indicate a desired partof the manipulation surface or an area having a desired size. As aresult, according to the embodiment, it is possible to enlarge a desiredenlargement target portion of image to be displayed on the displaysection, and to enlarge at least one part of the image at a desiredenlargement ratio to be displayed.

According to the embodiment of the present invention, it is possible torealize a display control apparatus, a display control method and adisplay control program in which if the indication manipulation for themanipulation surface is detected, the area in the manipulation surfaceindicated through the indication manipulation is detected, and the imageis enlarged on the basis of the detected area to be displayed on thedisplay section, and accordingly, the enlargement target portion of theimage or the enlargement ratio can be easily selected by performing theindication manipulation so as to indicate the desired part of themanipulation surface or the area having the desired size, and as aresult, the desired enlargement target portion of the image can beenlarged to be displayed on the display section, and at least one partof the image can be enlarged at the desired enlargement ratio to bedisplayed, thereby enhancing usability.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an embodiment of a circuitconfiguration of a display control apparatus according to the presentinvention;

FIG. 2 is a diagram schematically illustrating an embodiment of anexternal configuration of a mobile terminal;

FIG. 3 is a block diagram illustrating a circuit configuration based ona hardware circuit block of a mobile terminal;

FIG. 4 is a diagram schematically illustrating change in output valuesof an electrostatic sensor according to change in distance between amanipulation body and a manipulation surface;

FIGS. 5A and 5B are diagrams schematically illustrating detection of atouch area, a proximity area, and a non-proximity area;

FIG. 6 is a diagram schematically illustrating display of a web browserimage and a page image according to a tap manipulation;

FIG. 7 is a diagram schematically illustrating detection of anindication region in a case where the number of proximity areas due to acontinuous proximity manipulation is one;

FIG. 8 is a diagram schematically illustrating detection of anindication region in a case where there are a plurality of proximityareas due to a continuous proximity manipulation;

FIG. 9 is a diagram schematically illustrating a configuration of adetection table;

FIG. 10 is a diagram schematically illustrating a relationship betweenthe area of an indication region and an enlargement ratio of anenlargement target portion;

FIGS. 11A and 11B are diagrams schematically illustrating a cutout of anenlargement target portion from an image;

FIG. 12 is a diagram schematically illustrating a partially enlargeddisplay (1) of an image according to a continuous proximitymanipulation;

FIG. 13 is a diagram schematically illustrating a partially enlargeddisplay (2) of an image according to a continuous proximitymanipulation;

FIG. 14 is a diagram schematically illustrating an enlargement (1) of anenlargement target portion according to a continuous proximitymanipulation;

FIG. 15 is a diagram schematically illustrating an enlargement (2) of anenlargement target portion according to a continuous proximitymanipulation;

FIG. 16 is a diagram schematically illustrating an enlargement (3) of anenlargement target portion according to a continuous proximitymanipulation;

FIG. 17 is a diagram schematically illustrating a change (1) of anenlargement target portion according to a proximity movementmanipulation;

FIG. 18 is a diagram schematically illustrating a change (2) of anenlargement target portion according to a proximity movementmanipulation;

FIG. 19 is a diagram schematically illustrating a continuous change (1)of an enlargement target portion according to a proximity movementmanipulation;

FIG. 20 is a diagram schematically illustrating a continuous change (2)of an enlargement target portion according to a proximity movementmanipulation;

FIG. 21 is a flowchart illustrating a display control process routine(1);

FIG. 22 is a flowchart illustrating a display control process routine(2); and

FIG. 23 is a diagram schematically illustrating a modified embodiment ofa mobile terminal.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, preferred exemplary embodiments for carrying out thepresent invention will be described with reference to the accompanyingdrawings. The description will be made in the following order:

1. Embodiment

2. Modified embodiments

1. Embodiment 1-1. Outline of Embodiment

Firstly, an outline of an embodiment will be described. That is, afterdescription of the outline, a specific example according to the presentembodiment will be described.

In FIG. 1, reference numeral 1 generally represents a display controlapparatus according to an embodiment. A display section 2 in the displaycontrol apparatus 1 displays an image.

Further, a detecting section 3 in the display control apparatus 1detects an indication manipulation for a manipulation surface. Further,if the indication manipulation for the manipulation surface is detectedby the detecting section 3, a control section 4 in the display controlapparatus 1 detects the area in the manipulation surface indicated bythe indication manipulation, and enlarges an image on the basis of thedetected area to be displayed on the display section 2.

With such a configuration, the display control section 1 can easilyselect the enlargement target portion or the enlargement ratio of theimage by performing the indication manipulation so as to indicate adesired portion of the manipulation surface or an area of a desiredsize.

As a result, the display control section 1 can enlarge the desiredenlargement target portion of the image to be displayed on the displaysection 2, and can enlarge at least part of the image at a desiredenlargement ratio to be displayed. Thus, the display control apparatus 1can enhance usability.

1-2. Specific Example According to Embodiment

[1-2-1. External Configuration of Mobile Terminal]

Next, an external configuration of a mobile terminal 10 which is aspecific example of the above-described display control apparatus 1 willbe described with reference to FIG. 2. The mobile terminal 10 has aconfiguration in which a first casing 11 and a second casing 12 whichare approximately flat and rectangular are connected with each otherthrough hinge sections 13A and 13B to be able to be opened or closed,and has a size such as to be gripped with one hand as a whole.

In the mid portion of a front surface 11A of the first casing 11 isinstalled a first touch screen 14 of a rectangular shape. Further, inthe mid portion of a front surface 12A of the second casing 12 isinstalled a second touch screen 15 having the same shape and the samesize as the first touch screen 14.

The first touch screen 14 includes a first liquid crystal display panel,and a first touch panel of an electrostatic capacitance type which isarranged to cover a display surface of the first liquid crystal displaypanel.

Further, the first touch panel has a transparent thin sheet shape, sothat an image displayed on the display surface of the first liquidcrystal display panel can be seen from a front side of the first touchscreen 14.

In a similar way to the first touch screen 14, the second touch screen15 includes a second liquid crystal display panel, and a second touchpanel of an electrostatic capacitance type which is arranged to cover adisplay surface of the second liquid crystal display panel.

Further, in a similar way to the first touch panel, the second touchpanel has a transparent thin sheet shape, so that an image displayed onthe display surface of the second liquid crystal display panel can beseen from a front side of the second touch screen 15.

Further, in the first touch panel and the second touch panel, a touchmanipulation and a proximity manipulation are performed by amanipulation body including a finger of a user or a conductor such as atouch pen made of metal which is used by the user or the like, withrespect to their manipulation surfaces.

Hereinafter, the manipulation surface of the first touch panel isreferred to as “first manipulation surface”, and the manipulationsurface of the second touch panel is referred to as “second manipulationsurface”.

Here, the touch manipulation is a manipulation performed by bringing themanipulation body in touch with the first manipulation surface of thefirst touch panel or the second manipulation surface of the second touchpanel (hereinafter, referred to as “touch manipulation”).

Further, the proximity manipulation is a manipulation performed bymoving the manipulation body close to the first manipulation surface orthe second manipulation surface, without being in touch with the firstmanipulation surface of the first touch panel or the second manipulationsurface of the second touch panel. The first touch panel and the secondtouch panel correspond to a multi-touch panel.

Thus, the mobile terminal 10 receives the touch manipulation and theproximity manipulation by means of the manipulation body for thesurfaces of the first touch screen 14 and the second touch screen 15(that is, the first manipulation surface and the second manipulationsurface) as a manipulation input.

Further, the mobile terminal 10 is generally used in a posture in whichthe front surface 11A of the first casing 11 is positioned below theeyeline of the user and the front surface 12A of the second casing 12 ispositioned above the eyeline of the user.

Accordingly, the mobile terminal 10 uses the first touch screen 14 as alower screen, and uses the second touch screen 15 as an upper screen,according to such a general usage posture, to thereby display a varietyof images on these screens (display surfaces of the first liquid crystaldisplay panel and the second liquid crystal display panel).

Further, on the front surface 11A of the first casing 11 of the mobileterminal 10, a variety of manipulation buttons 16 such as a power buttonor the like are also installed at sides of the first touch screen 14.

Hereinafter, on a display surface of the first liquid crystal displaypanel 14A and the first manipulation surface of the first touch panel14B, the side of the hinge sections 13A and 13B which is one verticaldirection side of a screen is referred to as “up”, and the othervertical direction side of the screen is referred to as “down”.

Further, hereinafter, on the display surface of the first liquid crystaldisplay panel 14A and the first manipulation surface of the first touchpanel 14B, one horizontal direction side of the screen is referred to as“left”, and the other horizontal direction side of the screen isreferred to as “right”.

On the other hand, hereinafter, on a display surface of the secondliquid crystal display panel 15A and the second manipulation surface ofa second touch panel 15B, one vertical direction side of the screen isreferred to as “up”, and the side of the hinge sections 13A and 13Bwhich is one vertical direction side of the screen is referred to as“down”.

Further, hereinafter, on the display surface of the second liquidcrystal display panel 15A and the second manipulation surface of thesecond touch panel 15B, one horizontal direction side of the screen isreferred to as “left”, and the other horizontal direction side of thescreen is referred to as “right”.

[1-2-2. Hardware Configuration of Mobile Terminal]

Next, a hardware configuration of the mobile terminal 10 will bedescribed with reference to FIG. 3. A control section 20 including a CPU(central processing unit) is installed in the mobile terminal 10.

The control section 20 reads out a program stored in a non-volatilememory 21 in advance from the non-volatile memory 21 and expands it to aRAM (random access memory) 22. Further, the control section 20 performsa variety of processes according to the program and controls therespective sections.

Thus, the control section 20 detects whether the touch manipulation orthe proximity manipulation is performed for the surfaces of the firsttouch screen 14 and the second touch screen 15.

Further, if it is detected that the touch manipulation or the proximitymanipulation is performed for the surfaces of the first touch screen 14and the second touch screen 15, the control section 20 detects a commandor instruction which is input according to the touch manipulation or theproximity manipulation, and performs a process according to the commandor instruction.

In practice, as described above, the first touch screen 14 includes thefirst liquid crystal display panel 14A which displays an image and thefirst touch panel 14B of the electrostatic capacitance type.

The first touch panel 14B has, for example, a plurality of electrostaticsensors (not shown) which is arranged in a matrix form at an inner sideof the first manipulation surface, which faces a plurality of pixels ofthe first liquid crystal display panel 14A.

In the plurality of electrostatic sensors, if a manipulation body eachbeing made of a conductor moves close thereto, electrostaticcapacitances thereof are changed, and output values are also changedaccording to the change in the electrostatic capacitances.

For example, as shown in FIG. 4, if a fingertip which is an example ofthe manipulation body moves close to the first manipulation surface ofthe first touch panel 14B by a distance of 30 [mm], an output value ofthe electrostatic sensor which is positioned directly under thefingertip in the first manipulation surface becomes “10”.

Further, for example, if the fingertip which is the manipulation bodymoves close to the first manipulation surface of the first touch panel14B by a distance of 15 [mm], an output value of the electrostaticsensor which is positioned directly under the fingertip in the firstmanipulation surface becomes “20”.

Furthermore, for example, if the fingertip which is the manipulationbody moves close to the first manipulation surface of the first touchpanel 14B by a distance of 5 [mm], an output value of the electrostaticsensor which is positioned directly under the fingertip in the firstmanipulation surface becomes “40”.

In addition, for example, if the fingertip which is the manipulationbody is in touch with the first manipulation surface of the first touchpanel 14B, an output value of the electrostatic sensor which ispositioned in a portion which is in touch with the fingertip in thefirst manipulation surface becomes a maximum of “80”.

Accordingly, the control section 20 performs an area detection processat a predetermined time interval such as several [msec] or several[μsec], which are significantly short.

When performing the area detection process, the control section 20acquires an output value of each electrostatic sensor from the firsttouch panel 14B and positional information indicating an arrangementposition of the electrostatic sensor, as a panel output signal.

The arrangement position of the electrostatic sensor is represented bycoordinates (that is, two-dimensional coordinates indicating a positionwhere a pixel facing the electrostatic sensor is arranged in the firstliquid crystal display panel 14A) of a pixel position of the firstliquid crystal display panel 14A facing the electrostatic sensor, forexample.

Further, as shown in FIGS. 5A and 5B, the control section 20sequentially compares an output value of each electrostatic sensorincluded in the panel output signal with a preset first threshold value,for example, “50” and a preset second threshold value, for example,“20”.

Further, the control section 20 detects one or plural areas TA1 in whichthe electrostatic sensors which obtain the output values which are equalto or higher than the first threshold value are collected on the firstmanipulation surface, as the area or areas TA1 with which themanipulation body is in touch, respectively, on the basis of thecomparison result and the positional information included in the paneloutput signal.

Hereinafter, on the first manipulation surface of the first touch panel14B and the second manipulation surface of the second touch panel 15B,the one or plural areas TA1 with which the manipulation body is in touchare referred to as “the touch area or areas TA1”, respectively.

In practice, the control section 20 detects one or plural touch areasTA1 on the first manipulation surface as coordinates of pixel positionsfacing the electrostatic sensors which obtain output values equal to orhigher than the first threshold value, respectively.

If one or plural touch areas TA1 are detected in this way, the controlsection 20 detects, for example, each center position P1 of the detectedone or plural touch areas TA1 as the coordinates of the facing pixelpositions.

Further, at this time, the control section 20 detects one or pluralareas CA1 in which the electrostatic sensors which obtain output valueswhich are equal to or higher than the second threshold value and arelower than the first threshold value are collected on the firstmanipulation surface, as the area or areas CA1 which become shaded asthe manipulation body moves close thereto, respectively, on the basis ofthe comparison result and the positional information.

Further, hereinafter, on the first manipulation surface or the secondmanipulation surface, one or plural areas CA1 which becomes shaded asthe manipulation body moves close thereto (that is, one or plural areasCA1 in which a proximity portion of the manipulation body is projectedon the first manipulation surface or the second manipulation surface) isreferred to as “proximity area or areas CA1”, respectively.

Further, hereinafter, a range of the distance to the manipulation bodyfrom the first manipulation surface or the second manipulation surface,in which the proximity area CA1 can be detected in which the outputvalues of the electrostatic sensors are equal to or higher than thesecond threshold value and are lower than the first threshold value, isreferred to as “proximity detection distance range”.

In practice, the control section 20 detects one or plural touch areasTA1 on the first manipulation surface as the coordinates of the pixelpositions facing the electrostatic sensors which obtain the outputvalues which are equal to or higher than the second threshold value andare lower than the first threshold value, respectively.

Even when one or plural proximity areas CA1 are detected in this way,the control section 20 also detects, for example, each center positionP2 of the detected one or plural proximity areas CA1, as the coordinatesof the facing pixel positions.

However, in a case where the touch manipulation is performed on thefirst manipulation surface of the first touch panel 14B, only the tipsection of the manipulation body may be in touch with the firstmanipulation surface in a state where the manipulation body such as afinger is obliquely inclined.

In this case, in the first touch panel 14B, an output value of theelectrostatic sensor which is disposed in the touching portion of themanipulation body on the first manipulation surface becomes a maximum of“80”, as described above.

Further, in the first touch panel 14B, an output value of theelectrostatic sensor which is disposed in the portion which becomesshaded by the manipulation body (non-touching portion which is directlyunder the manipulation body) on the first manipulation surface decreasesas it becomes distant from the touching portion of the manipulationbody, for example.

Thus, when simply using comparison results between the output value ofthe electrostatic sensor and the first and second threshold values, thecontrol section 20 detects, within the portion which becomes shaded bythe manipulation body of which the tip section is in touch with thefirst manipulation surface, the tip section and the touching portion ofthe tip section as the touch area TA1.

Further, at this time, the control section 20 may detect a part which isspaced away from the tip section within the portion which becomes shadedby the manipulation body of which the tip section is in touch with thefirst manipulation surface, as the proximity area CA1 which is connectedto the touch area TA1, according to the angle of the manipulation bodywith respect to the first manipulation surface.

Here, the control section 20 employs the touch manipulation and theproximity manipulation as a manipulation for inputting differentcommands or for performing different instructions, and detects the toucharea TA1 or the proximity area CA1 in order to individually detect thatthe touch manipulation or the proximity manipulation is performed.

Thus, if the touch area TA1 and the proximity area CA1 which isconnected to the touch area TA1 are simultaneously detected, the controlsection 20 validates only the detection of one touch area TA1 andnegates the detection of the other proximity area CA1 on the basis ofthe comparison results between the output value of the electrostaticsensor and the first and second threshold values.

That is, if the touch area TA1 and the proximity area CA1 which isconnected to the touch area TA1 are simultaneously detected, the controlsection 20 determines that the touch area TA1 through the touchmanipulation performed on the first manipulation surface is detected andcancels the detection of the proximity area CA1 as a false detection.

Thus, when the touch manipulation is performed on the first manipulationsurface, the control section 20 prevents a false operation (that is,performing a false process) due to the false determination that theproximity area CA1 is detected and the proximity manipulation isperformed.

Further, at this time, the control section 20 detects one or pluralareas NA1 in which the electrostatic sensors which obtain output valueslower than the second threshold value are collected on the firstmanipulation surface, as the area or areas NA1 which the manipulationbody is neither in touch with nor moves close to, on the basis of thecomparison result and the positional information, respectively.

Hereinafter, on the first manipulation surface of the first touch panel14B or the second manipulation surface of the second touch panel 15B,one or plural areas NA1 which the manipulation body is neither in touchwith nor moves close to are referred to as “non-proximity area or areasNA1”, respectively.

Further, at this time, the control section 20 detects one or pluralnon-proximity areas NA1 on the first manipulation surface as coordinatesof pixel positions facing the electrostatic sensors which obtain outputvalues lower than the second threshold value, respectively.

In this way, whenever performing the area detection process, the controlsection 20 performs the detection so that one or plural touch areas TA1,one or plural proximity areas CA1, or one or plural non-proximity areasNA1 are distinguished from each other on the first manipulation surfaceof the first touch panel 14B.

Further, the control section 20 may recognize whether the manipulationbody is in touch with or moves close to the first manipulation surface,by performing the detection so that the touch area TA1, the proximityarea CA1 and the non-proximity area NA1 are distinguished from eachother on the first manipulation surface of the first touch panel 14B.

Further, at this time, the control section 20 may recognize whichposition the manipulation body is in touch with or moves close to, onthe first manipulation surface of the first touch panel 14B.

Furthermore, the control section 20 may recognize the shape or size ofthe touch area TA1 of the manipulation body on the first manipulationsurface of the first touch panel 14B, the shape or size of the proximityarea CA1 of the manipulation body for the first manipulation surface, orthe like.

In this way, the control section 20 obtains the panel output signal fromthe first touch panel 14B at a predetermined time interval and detectsthe touch area TA1, the proximity area CA1 and the non-proximity areaNA1 on the first manipulation surface, to thereby detect theirtransitions.

Further, the control section 20 specifies the movement of themanipulation body on the first manipulation surface of the first touchpanel 14B on the basis of the transitions, and recognizes the touchmanipulation and the proximity manipulation performed for the firstmanipulation surface on the basis of the specified movement of themanipulation body.

Further, the control section 20 detects a command which is inputaccording to the recognized touch manipulation and proximitymanipulation, and performs a process according to the command orinstruction.

In this way, if the touch manipulation or the proximity manipulation isperformed for the first manipulation surface of the first touch screen14, the control section 20 receives it as a manipulation input, andperforms a process according to the manipulation input.

On the other hand, the second touch screen 15 includes the second liquidcrystal display panel 15A which displays an image, and the second touchpanel 15B of the electrostatic capacitance type, as described above.

The second touch panel 15B is configured in a similar way to the firsttouch panel 14B, and has a plurality of electrostatic sensors (notshown) which are arranged at an inner side of the second manipulationsurface in a matrix form, facing the plurality of pixels of the secondliquid crystal display panel 15A, for example.

Further, in a plurality of electrostatic sensors of the second touchpanel 15B, if the manipulation body each being made of a conductor movesclose thereto, electrostatic capacitances thereof are changed in asimilar way to the case of the plurality of electrostatic sensors in thefirst touch panel 14B, and output values are also changed according tothe change in the electrostatic capacitances.

Thus, when performing the area detection process at a predetermined timeinterval, the control section 20 obtains an output value of eachelectrostatic sensor from the second touch panel 15B in a similar way tothe case of the first touch panel 14B and positional informationindicating the arrangement position of the electrostatic sensor, as apanel output signal.

For example, the arrangement position of the electrostatic sensor isindicated by coordinates of the pixel position of the second liquidcrystal display panel 15A facing the electrostatic sensor (that is,two-dimensional coordinates indicating the position in which a pixelfacing the electrostatic sensor is arranged in the second liquid crystaldisplay panel 15A).

Further, if the panel output signal is obtained from the second touchpanel 15B in the area detection process, the control section 20appropriately detects one or plural touch areas or one or pluralproximity areas and the center positions thereof on the secondmanipulation surface using the panel output signal.

Further, whenever the area detection process is performed, the controlsection 20 also detects one or plural non-proximity areas on the secondmanipulation surface of the second touch panel 15B.

That is, whenever the area detection process is performed, the controlsection 20 also performs the detection so that one or plural touchareas, one or plural proximity areas and one or plural non-proximityareas are distinguished from each other on the second manipulationsurface of the second touch panel 15B.

Accordingly, the control section 20 may also recognize whether themanipulation body is in touch with or moves close to the secondmanipulation surface, on the second manipulation surface of the secondtouch panel 15B.

Further, at this time, the control section 20 may also recognize whichposition the manipulation body is in touch with or moves close to, onthe second manipulation surface of the second touch panel 15B.

Furthermore, the control section 20 may also recognize the shape or sizeof the touch area of the manipulation body on the second manipulationsurface of the second touch panel 15B, the shape or size of theproximity area of the manipulation body for the second manipulationsurface, or the like.

The control section 20 obtains a panel output signal from the secondtouch panel 15B at a predetermined time interval in this way, anddetects the touch area, the proximity area and the non-proximity area onthe second manipulation surface, to thereby detect their transitions.

Further, the control section 20 specifies the movement of themanipulation body on the second manipulation surface of the second touchpanel 15B on the basis of the transitions, and recognizes the touchmanipulation and the proximity manipulation performed for the secondmanipulation surface on the basis of the specified movement of themanipulation body.

Further, the control section 20 detects the command or instruction whichis input according to the recognized touch manipulation and proximitymanipulation, and then performs the process according to the command orinstruction.

In this way, if the touch manipulation or the proximity manipulation isperformed for the second manipulation surface of the second touch screen15, the control section 20 receives it as a manipulation input andperforms a process according to the manipulation input.

However, as the touch manipulation performed on the first manipulationsurface of the first touch panel 14B or the second manipulation surfaceof the second touch panel 15B, there is a manipulation in which onefinger which is an example of the manipulation body is in touch withapproximately one point of the first manipulation surface or the secondmanipulation surface and then is immediately disengaged therefrom.

Hereinafter, the manipulation in which one finger which is themanipulation body is in touch with the first manipulation surface or thesecond manipulation surface and then is immediately disengaged therefromis referred to as “tap manipulation”, in particular. The tapmanipulation is, for example, performed to indicate indication itemssuch as an icon, button or the like in an image.

Further, as the touch manipulation performed on the first manipulationsurface of the first touch panel 14B or the second manipulation surfaceof the second touch panel 15B, for example, there is a manipulation inwhich one finger which is an example of the manipulation body is movedwhile being in touch with the first manipulation surface or the secondmanipulation surface.

Hereinafter, the manipulation in which one finger which is themanipulation body is moved while being in touch with the firstmanipulation surface or the second manipulation surface is referred toas “sliding manipulation”, in particular. For example, the slidingmanipulation is performed to scroll an image being displayed to change adisplayed portion.

Accordingly, whenever the area detection process is performed, if thetouch area and the center position thereof are detected on the basis ofthe panel output signal obtained from the first touch panel 14B, thecontrol section 20 determines the type of the touch manipulationperformed on the first manipulation surface on the basis of the seriesof detection results.

In practice, the control section 20 holds in advance maximum movementdistance information indicating the maximum movement distance in whichthe manipulation body which performs the touch manipulation or theproximity manipulation is movable, at the above-described predeterminedtime which is a performance interval of the area detection process.

Further, if the panel output signal is obtained from the first touchpanel 14B by performing the area detection process and one touch areaand the center position thereof are detected, the control section 20determines whether the touch area is detected in the previous (one timebefore) area detection process in each case.

As a result, if the touch area is not detected at all in the previousarea detection process, the control section 20 determines that one toucharea detected in a current area detection process is a touch area at thetime when the touch of the manipulation body on the first manipulationsurface is started.

On the other hand, if the touch area is detected in the previous areadetection process, the control section 20 calculates the distance(hereinafter, referred to as “inter-center distance”) between the centerposition detected in the previous area detection process and the centerposition detected in the current area detection process in a round-robinmanner.

Further, the control section 20 compares the calculated one or pluralinter-center distances with the maximum movement distance, respectively.Further, the control section 20 determines whether the center positionwithin the maximum movement distance from the center position detectedin the previous area detection process is detected in the current areadetection process, on the basis of the comparison result.

As a result, if the center position within the maximum movement distancefrom the previous center position is detected in the current areadetection process, the control section 20 determines that the previousand current touch areas corresponding to the previous and current centerpositions are the touch areas of the same manipulation body (forexample, the same finger).

That is, if the center position within the maximum movement distancefrom the previous center position is detected in the current areadetection process, the control section 20 determines that the touch areacorresponding to the current center position is the touch area of themanipulation body which has been in touch with the first manipulationsurface from the time of the previous area detection process.

Further, if a center position which is distant beyond the maximummovement distance from any previous center position is detected in thecurrent area detection process, the control section 20 determines thatthe touch area corresponding to the current center position is a toucharea at the time when a touch of a new (different) manipulation body isstarted on the first manipulation surface.

Further, if a center position in which the inter-center distance to anyprevious center position is equal to or smaller than the maximummovement distance is not detected in the current area detection process,the control section 20 determines that the touch area corresponding tothe previous center position is a touch area at the time when the touchof the manipulation body on the first manipulation surface isterminated.

That is, if the touch area of the center position in which theinter-center distance to the previous center position is equal to orsmaller than the maximum movement distance is not detected in thecurrent area detection process, the control section 20 determines thatthe touch area corresponding to the previous center position is a toucharea immediately before the manipulation body is disengaged from thefirst manipulation surface.

Further, if the touch area is not detected at all although the areadetection process is performed, the control section 20 also determineswhether the touch area is detected in the previous (one time before)area detection process.

As a result, if the touch area is detected in the previous areadetection process, the control section 20 determines that the previoustouch area is a touch area at the time when the touch of themanipulation body on the first manipulation surface is terminated.

That is, even though the touch area is detected in the previous areadetection process, if the touch area is not detected at all in thecurrent area detection process, the control section 20 determines thatthe previous touch area is a touch area immediately before themanipulation body is disengaged from the first manipulation surface.

In this way, the control section 20 sequentially performs the areadetection processes, to thereby detect the touch area whenever themanipulation body is in touch with the first manipulation surface whenthe touch manipulation is started.

Further, the control section 20 sequentially performs the area detectionprocesses, to thereby sequentially trace one touch area by means of themanipulation body for detection while the manipulation body is in touchwith the first manipulation surface (while the touch manipulation isbeing performed on the first manipulation surface).

That is, if the control section 20 performs the area detection processto detect one touch area at the time when the touch of the manipulationbody is started, the control section 20 sequentially performs the areadetection processes, to thereby trace the one touch area by means of themanipulation body until the touch of the manipulation body isterminated.

With such a configuration, for example, if the one touch area isdetected as the touch area at the time when the touch of themanipulation body is started in a state where the touch area is notdetected at all (in a state where the touch manipulation is notperformed on the first manipulation surface), at this time, the controlsection 20 determines that the touch manipulation is started.

At this time, the control section 20 starts measurement of the time(hereinafter, referred to as “touch time”) when the manipulation body isin touch with the first manipulation surface by the touch manipulationperformed on the first manipulation surface, for example, by a timer(not shown), according to the determination that the touch manipulationis started.

Further, for example, the control section 20 also starts the detectionof the movement trace of the manipulation body, using the centerposition of the touch area at the time when the touch of themanipulation body is started as a starting point, according to the startof the touch manipulation.

Whenever the control section 20 detects the touch area and the centerposition thereof by means of the touch manipulation by performing thearea detection process after the touch manipulation is started, thecontrol section 20 sequentially traces the detected center position fromthe starting point (center position), to thereby detect the movementtrace of the manipulation body.

Further, the control section 20 compares the touch time with apredetermined time selected in advance for detection of the touchmanipulation, for example, which is equal to or shorter than 1 [sec](hereinafter, referred to as “tap detection time”).

As a result, if the touch manipulation is terminated before the touchtime reaches the tap detection time and the measurement of the touchtime is terminated, the control section 20 determines whether themovement trace detected thus far falls within a circle of apredetermined radius centering on the starting point (center position).

The circle centering on the starting point is used for detecting thetype of the touch manipulation. Hereinafter, the circle is referred toas a “type detection circle”. Further, the radius of the type detectioncircle is selected in advance with a predetermined length equal to orshorter than 1 [mm], for example.

If the movement trace of the manipulation body from the start of thetouch manipulation to the end thereof falls within the type detectioncircle, at this time the control section 20 determines that the touchmanipulation performed on the first manipulation surface is the tapmanipulation.

Further, the control section 20 uses the center position (that is, thecenter position indicated by the coordinates of the pixel position) ofthe touch area at the time when the touch of the manipulation bodythrough the tap manipulation is terminated, as a tap indication positionindicated by the tap manipulation in an image displayed on the displaysurface of the first liquid crystal display panel 14A at this time.

In this respect, if the movement trace of the manipulation body from thestart of the touch manipulation to the end thereof extends outside thetype detection circle, at this time, the control section 20 determinesthat the touch manipulation performed on the first manipulation surfaceis not the tap manipulation.

Further, if the touch time measured by a timer is beyond the tapdetection time, whenever the movement trace of the manipulation body issequentially updated according to the detection of the center position,the control section 20 determines whether the updated movement traceextends outside the type detection circle.

As a result, if it is detected that the movement trace of themanipulation body extends outside the type detection circle in the touchmanipulation performed beyond the tap detection time, at this time, thecontrol section 20 determines that the touch manipulation performed onthe first manipulation surface is the sliding manipulation.

In this case, until the sliding manipulation is terminated after thetime (hereinafter, referred to as “sliding manipulation detection time”)when it is detected that the touch manipulation is the slidingmanipulation, the control section 20 sequentially updates the movementtrace of the manipulation body according to the detection of the centerposition. Further, the control section 20 uses the movement trace of themanipulation body through the sliding manipulation for image scrolling,for example.

If the touch manipulation is terminated in a state where the movementtrace of the manipulation body falls within the type detection circle inthe touch manipulation performed beyond the tap detection time, at thistime, the control section 20 determines that the manipulation body ismistakenly in touch with the first manipulation surface and the touchmanipulation is not performed.

In this way, the control section 20 can detect that the tap manipulationis performed using one finger which is an example of the manipulationbody on the first manipulation surface of the first touch panel 14B.

Further, the control section 20 can also detect that the slidingmanipulation is performed using one finger which is the example of themanipulation body on the first manipulation surface of the first touchpanel 14B.

On the other hand, if the control section 20 performs the area detectionprocess to detect the touch area and the center position thereof on thebasis of the panel output signal obtained from the second touch panel15B, similarly, the control section 20 performs the same process as theprocess for detecting the type of the touch manipulation performed onthe first manipulation surface.

Accordingly, the control section 20 can detect that the tap manipulationis performed using one finger which is the example of the manipulationbody on the second manipulation surface of the second touch panel 15B.

Further, the control section 20 can also detect that the slidingmanipulation is performed using one finger which is the example of themanipulation body on the second manipulation surface of the second touchpanel 15B.

However, for example, image data on a variety of images such as a menuimage in which the indication items indicating a variety of commands arearranged is stored in advance in the non-volatile memory 21. Further, acommand detection table generated for each image is stored in advance inthe non-volatile memory 21.

Arrangement area information indicating arrangement areas of theindication items in the corresponding image as coordinates of pixelpositions and commands which can be input, which are allocated to theindication items, are correspondingly stored in each command detectiontable.

Accordingly, in a case where the control section 20 reads the image datafrom the non-volatile memory 21, and for example, displays the imagebased on the image data on the first liquid crystal display panel 14A,the control section 20 reads out the command detection tablecorresponding to the image data into the RAM 22 from the non-volatilememory 21 for command detection.

In this state, if it is detected that the tap manipulation is performedon the first manipulation surface of the first touch panel 14B, thecontrol section 20 detects an arrangement area including the tapindication position through the tap manipulation from among thearrangement areas indicated by the plural pieces of arrangement areainformation stored in the command detection table.

Further, the control section 20 detects the command (that is, a commandcorresponding to the arrangement area including the tap indicationposition) which is input by the tap manipulation at this time, on thebasis of the command detection table.

In this way, the control section 20 detects the command input by the tapmanipulation and performs a process according to the detected command.

Further, if an image is displayed on the first liquid crystal displaypanel 14A, the control section 20 determines whether the entire imagecan be displayed on the display surface, and then recognizes whether theimage can be scrolled according to the determination result.

Accordingly, if it is detected that the sliding manipulation isperformed on the first manipulation surface in a state where the imagecan be scrolled, the control section 20 scrolls the image which is beingdisplayed on the first liquid crystal display panel 14A, for example, soas to trace the movement of the manipulation body, on the basis of themovement trace detected at this time.

Further, if it is detected that the sliding manipulation is performed onthe first manipulation surface in a state where the image is unable tobe scrolled, the control section 20 negates the detection.

Further, when it is detected that the tap manipulation is performed onthe second manipulation surface of the second touch panel 15B, in astate where the image is displayed on the second liquid crystal displaypanel 15A, similarly, the control section 20 detects the command inputby the tap manipulation.

Further, if the command input by the tap manipulation is detected inthis way, the control section 20 performs a process according to thedetected command.

Further, when the image is displayed on the second liquid crystaldisplay panel 15A, the control section 20 also detects whether theentire image can be displayed on the display surface, and thenrecognizes whether the image can be scrolled according to the detectionresult.

Accordingly, if it is detected that the sliding manipulation isperformed on the second manipulation surface in a state where the imagecan be scrolled, the control section 20 scrolls the image which is beingdisplayed on the second liquid crystal display panel 15A, for example,so as to trace the movement of the manipulation body, on the basis ofthe movement trace detected at this time.

If it is detected that the sliding manipulation is performed on thesecond manipulation surface in a state where the image is unable to bescrolled, similarly, the control section 20 negates the detection.

In practice, for example, in a state where an image having an indicationitem (reproduction button) to which a reproduction command forreproducing music data is allocated is displayed on the first liquidcrystal display panel 14A, if the indication item is indicated by thetap manipulation, the control section 20 recognizes that thereproduction command is input.

In this case, the control section 20 reads out the music data from thenon-volatile memory 21 according to the input of the reproductioncommand to transmit it to a reproducing section 23.

The reproducing section 23 performs a reproduction process such as adecoding process, a digital-analog conversion process, an amplificationprocess and the like for the music data under the control of the controlsection 20, to thereby generate a music signal and output it through aheadphone terminal (not shown).

Thus, the control section 20 can allow the user to listen to musicthrough headphones connected to the headphone terminal.

At this time, the control section 20 reads out information about tracktitles, artist names or the like relating to the music data from thenon-volatile memory 21, and then displays it on the second liquidcrystal display panel 15A, for example.

Accordingly, the control section 20 can present the information aboutthe music which is being reproduced to the user through the secondliquid crystal display panel 15A.

Further, for example, in a state where an image having an indicationitem to which a start-up command for starting a web browser is allocatedis displayed on the first liquid crystal display panel 14A, if theindication item is indicated by the tap manipulation, the controlsection 20 recognizes that the start-up command is input.

In this case, as shown in FIG. 6, the control section 20 starts up theweb browser according to the input of the start-up command, and displaysa web browser image 30 across the second liquid crystal display panel15A to the first liquid crystal display panel 14A.

That is, at this time, the control section 20 considers both the displaysurfaces of the second liquid crystal display panel 15A and the firstliquid crystal display panel 14A as one display surface, and displaysthe web browser image 30 on these display surfaces.

Further, at this time, the control section 20 receives page data on aweb page from a server on a network through a network interface 24, anddisplays a page image 31 based on the page data in the web browser image30.

Thus, the control section 20 can allow a user to browse the web browserimage 30 and the web page (that is, page image 31) through the firstliquid crystal display panel 14A and the second liquid crystal displaypanel 15A.

At this time, for example, if it is detected that the slidingmanipulation for moving the manipulation body from the lower side to theupper side indicated by an arrow a is performed on the firstmanipulation surface of the first touch panel 14B, the control section20 scrolls the entire web browser image 30 together with the page image31 up.

Further, for example, if it is detected that the sliding manipulationfor moving the manipulation body from the lower side to the upper sideis performed on the second manipulation surface of the second touchpanel 15B at this time, similarly, the control section 20 scrolls theentire web browser image 30 together with the page image 31 up.

Further, at this time, if the sliding manipulation for moving themanipulation body from the upper side to the lower side is performed onthe first manipulation surface or the second manipulation surface, thecontrol section 20 may scroll the entire web browser image 30 togetherwith the page image 31 down according to the sliding manipulation.

Accordingly, even in the case where the entire page image 31 is unableto be displayed across both the display surfaces of the second liquidcrystal display panel 15A and the first liquid crystal display panel14A, the control section 20 may appropriately scroll the page image 31to be completely displayed.

However, the indication items to which a variety of commands isallocated are arranged in the page image 31. Further, in the page image31, position-in-image information indicating the arrangement areas ofthe indication items as the coordinates in the image and the commandsallocated to the indication items are correspondingly added.

If the indication items of the page image 31 are displayed on the firstliquid crystal display panel 14A, the control section 20 matches thecommands allocated to the indication items with the display areainformation indicating the display areas of the indication items on thefirst liquid crystal display panel 14A as the coordinates of the pixelpositions.

Further, if the indication items of the page image 31 are displayed onthe second liquid crystal display panel 15A, the control section 20matches the commands allocated to the indication items with the displayarea information indicating the display areas of the indication items onthe second liquid crystal display panel 15A as the coordinates of thepixel positions.

In a case where the page image 31 is scrolled to displace the displayareas of the indication items, the control section 20 changes thedisplay area information corresponding to the commands allocated to theindication items into display area information indicating the displayareas after transition as the coordinates of the pixel positions.

Accordingly, if it is detected that the tap manipulation is performed onthe first manipulation surface of the first touch panel 14B, the controlsection 20 detects a display area including the tap indication positionthrough the tap manipulation, from the display areas indicated by onepiece or plural pieces of display area information on the first liquidcrystal display panel 14A.

Thus, the control section 20 detects a command (that is, a commandcorresponding to the display area including the tap indication position)input by the tap manipulation performed on the page image 31 at thistime.

Further, if it is detected that the tap manipulation is performed on thesecond manipulation surface of the second touch panel 15B, the controlsection 20 detects a display area including the tap indication positionthrough the tap manipulation, from the display areas indicated by onepiece or plural pieces of display area information on the second liquidcrystal display panel 15A.

Thus, the control section 20 detects a command (that is, a commandcorresponding to the display area including the tap indication position)input by the tap manipulation performed on the page image 31 at thistime.

Further, if the command input by the tap manipulation is detected inthis way, the control section 20 receives new page data from the serveraccording to the detected command, for example, and performs a processof displaying the page image based on the page data.

In this way, even in the case where the image acquired from the outsidesuch as a page image 31 is displayed, if the tap manipulation isperformed on the image, the control section 20 detects the command inputby the tap manipulation and performs a corresponding process.

[1-2-3. Display Control Process According to Proximity Manipulation]

However, as the proximity manipulation which is performed for the firstmanipulation surface of the first touch panel 14B or the secondmanipulation surface of the second touch panel 15B, there is amanipulation which is performed in a state where the manipulation bodymoves close to the first manipulation surface or the second manipulationsurface while barely moving the manipulation body over the firstmanipulation surface or the second manipulation surface.

Hereinafter, the manipulation which is performed in a state where themanipulation body moves close to the first manipulation surface or thesecond manipulation surface while barely moving the manipulation bodyover the first manipulation surface or the second manipulation surfaceis particularly referred to as “continuous proximity manipulation”.

Continuous proximity manipulation is also a manipulation which isperformed to enlarge an enlargement target portion at a randomenlargement ratio to be displayed by using part of the image as theenlargement target portion, when the image is displayed on the firstliquid crystal display panel 14A or the second liquid crystal displaypanel 15A.

Here, if the manipulation body moves close to only a single location inthe first manipulation surface or the second manipulation surface asdescribed above, the control section 20 detects only one proximity area,and if each manipulation body moves close to a plurality of locations inthe first manipulation surface or the second manipulation surface, thecontrol section 20 can detect a plurality of proximity areas at a time.

Accordingly, the continuous proximity manipulation can indicate adesired indication region by the size of the proximity area, the numberof proximity areas, the positional relationship between the plurality ofproximity areas or the like, detected by the continuous proximitymanipulation.

Further, the continuous proximity manipulation can roughly indicate theenlargement target portion which is part of the image on the basis ofthe indication region and can arbitrarily indicate an enlargement ratioof the enlargement target portion.

Thus, the continuous proximity manipulation may be performed by, forexample, one finger (only one finger moves close to the firstmanipulation surface or the second manipulation surface), a plurality offingers (plural fingers simultaneously move close to the firstmanipulation surface or the second manipulation surface), or the like,with respect to the first manipulation surface or the secondmanipulation surface.

Further, as the proximity manipulation which is performed for the firstmanipulation surface of the first touch panel 14B or the secondmanipulation surface of the second touch panel 15B, there is amanipulation which is performed to move the manipulation body over thefirst manipulation surface or the second manipulation surface in a statewhere the manipulation body moves close to the first manipulationsurface or the second manipulation surface.

Hereinafter, the manipulation which is performed to move themanipulation body over the first manipulation surface or the secondmanipulation surface, in a state where the manipulation body moves closeto the first manipulation surface or the second manipulation surface, isparticularly referred to as “proximity movement manipulation”.

The proximity movement manipulation is a manipulation which is performedto indicate a change in the indication region and a change in theenlargement target portion subsequent to the continuous proximitymanipulation, when the image is displayed on the first liquid crystaldisplay panel 14A or the second liquid crystal display panel 15A.

Thus, if the continuous proximity manipulation is performed, forexample, by one finger, the proximity movement manipulation is performedby only one finger subsequent to the continuous proximity manipulation,and if the continuous proximity manipulation is performed, for example,by a plurality of fingers, the proximity movement manipulation isperformed by the plurality of fingers subsequent to the continuousproximity manipulation.

For this reason, if the proximity manipulation is performed, forexample, by only one finger for the first manipulation surface or thesecond manipulation surface, whenever the area detection process isperformed, from the start of the proximity manipulation to the endthereof, the control section 20 detects one proximity area by the onefinger.

Further, similarly, in a case where the proximity manipulation isperformed, for example, by the plurality of fingers for the firstmanipulation surface or the second manipulation surface (in a case wherethe plurality of fingers simultaneously move close to the firstmanipulation surface or the second manipulation surface), whenever thearea detection process is performed, from the start of the proximitymanipulation to the end thereof, the control section 20 detects theproximity areas.

At this time, if the plurality of fingers is arranged in touch with eachother, the control section 20 detects one proximity area, for example,whenever the area detection process is performed, from the start of theproximity manipulation to the end thereof.

Further, if the plurality of fingers is separated from each other, thecontrol section 20 detects the proximity areas of the plurality offingers, for example, whenever the area detection process is performed,during the proximity manipulation.

Further, if a panel output signal is obtained from the first touch panel14B to detect one or plural proximity areas and the center positionthereof whenever the area detection process is performed, the controlsection 20 detects the type of the proximity manipulation which isperformed on the first manipulation surface, on the basis of the seriesof detection results.

Further, similarly, in a case where a panel output signal is obtainedfrom the second touch panel 15B to detect one or plural proximity areasand the center position thereof whenever the area detection process isperformed, the control section 20 detects the type of the proximitymanipulation which is performed on the second manipulation surface, onthe basis of the series of detection results.

Here, if the plurality of fingers is separated from each other when theproximity manipulation is performed by the plurality of fingers for thefirst manipulation surface or the second manipulation surface, a timedifference may occur when the respective fingers move close to the firstmanipulation surface and reach within a proximity detection distancerange according to bending degrees of the respective fingers.

That is, if the plurality of fingers is separated from each other whenthe proximity manipulation is performed, when the plurality of fingersmoves close to the first manipulation surface or the second manipulationsurface (when the proximity manipulation is started), the controlsection 20 may start to detect the plurality of proximity areas to beslightly shifted in terms of time by the plurality of fingers.

Further, even though the control section 20 starts to detect theplurality of proximity areas to be slightly shifted in terms of time bythe plurality of fingers when the proximity manipulation is started inthis way, the control section 20 should not mistakenly detect theplurality of proximity areas as proximity areas of different proximitymanipulations.

That is, even though the control section 20 starts to detect theplurality of proximity areas to be slightly shifted in terms of timeusing the plurality of fingers when the proximity manipulation isstarted, the control section 20 should detect the type of the proximitymanipulation using the plurality of proximity areas as areas based onthe same proximity manipulation.

For this reason, in the area detection process, for example, if thepanel output signal is obtained from the first touch panel 14B to detectone or plural proximity areas and the center position thereof, thecontrol section 20 determines whether the proximity area is detected inthe previous (one time before) area detection process.

As a result, if the proximity area is not detected at all in theprevious area detection process, the control section 20 determines thatone or plural proximity areas detected in the current area detectionprocess is a proximity area at the time when the manipulation bodystarts to move close to the first manipulation surface, respectively.

On the other hand, if one or plural proximity areas are detected in theprevious area detection process, the control section 20 calculates theinter-center distance between the center position detected in theprevious area detection process and the center position detected in thecurrent area detection process in a round-robin manner.

Further, the control section 20 compares the calculated one or pluralinter-center distances with the maximum movement distance, respectively.Further, the control section 20 determines whether the center positionwithin the maximum movement distance from the center position detectedin the previous area detection process is detected in the current areadetection process, on the basis of the comparison result.

As a result, if the center position within the maximum movement distancefrom the previous center position is detected in the current areadetection process, the control section 20 determines that the previousand current proximity areas corresponding to the previous and currentcenter positions are proximity areas based on the same manipulation body(the same finger).

That is, if the center position within the maximum movement distancefrom the previous center position is detected in the current areadetection process, the control section 20 determines that the proximityarea corresponding to the center position is a proximity area of themanipulation body which has been close to the first manipulation surfacefrom the time of the previous area detection process.

Here, if one or plural center positions which are distant beyond themaximum movement distance from any previous center position areadditionally detected in the current area detection process, the controlsection 20 determines that the proximity area corresponding to thedetected center position is also the proximity area at the time when theproximity is started.

That is, when the plurality of fingers moves close to the firstmanipulation surface as described above, if the control section 20starts to detect the plurality of proximity areas to be slightly shiftedin terms of time by the plurality of fingers, the control section 20determines that these proximity areas which start to be slightly shiftedin terms of time are the proximity areas at the time when the proximityis started, respectively.

Further, if a center position having an inter-center distance to theprevious center position equal to or shorter than the maximum movementdistance is not detected in the current area detection process, thecontrol section 20 determines that the manipulation body which has beenin proximity to the proximity area corresponding to the previous centerposition moves away beyond the proximity detection distance range.

That is, if the proximity area of the center position having a distancefrom the previous center position equal to or shorter than the maximummovement distance is not detected in the current area detection process,the control section 20 determines that the proximity area correspondingto the previous center position is a proximity area at the time when theproximity of the manipulation body to the first manipulation surface isterminated.

Further, similarly, if the proximity area is not detected at all eventhough the area detection process is performed, the control section 20determines whether the proximity area is detected in the previous (onetime before) area detection process.

As a result, if the proximity area is detected in the previous areadetection process, the control section 20 determines that the previousproximity area is a proximity area immediately before the manipulationbody deviates from the proximity detection distance range from the firstmanipulation surface.

That is, even though the proximity area is detected in the previous areadetection process, if the proximity area is not detected at all in thecurrent area detection process, the control section 20 determines thatthe previous proximity area is a proximity area at the time when theproximity of the manipulation body to the first manipulation surface isterminated.

In this way, by sequentially performing the area detection processes,when the proximity manipulation is started, the control section 20detects the proximity area whenever the manipulation body which has beenin proximity to the first manipulation surface reaches within theproximity detection distance range.

Further, by sequentially performing the area detection processes, whilethe manipulation body is moving close to the first manipulation surfacewithin the proximity detection distance range (while the proximitymanipulation is being performed for the first manipulation surface), thecontrol section 20 performs the detection to sequentially trace one orplural proximity areas through the manipulation body.

That is, if the area detection process is performed to detect one orplural proximity areas when the proximity of the manipulation body isstarted, the control section 20 then traces one or plural proximityareas using the manipulation body until the proximity of themanipulation body is terminated by sequentially performing the areadetection processes.

With such a configuration, if one proximity area is detected when theproximity is started in a state where the proximity area and the toucharea are not detected at all (in a state where the touch manipulationand the proximity manipulation are not detected at all), at this time,the control section 20 determines that the proximity manipulation isstarted.

Further, the control section 20 starts measurement of the time when theproximity manipulation is performed (that is, the time when themanipulation body is in proximity to the first manipulation surface,which is hereinafter referred to as “proximity time”) by the timer (notshown), according to the start of the proximity manipulation.

If a proximity area which is to be detected as a proximity area at thetime when the proximity is newly started is not additionally detected ina predetermined period when the area detection processes are performed,for example, several times or several tens of times, immediately afterthe proximity manipulation is started, the control section 20 determinesthat the proximity area through the proximity manipulation is only one.

That is, the control section 20 determines that only one proximity areadetected when the start of the proximity manipulation is a proximityarea through the proximity manipulation which is being performed at thistime, and traces the one proximity area until the proximity manipulationis terminated.

On the other hand, if one or plural proximity areas are additionallydetected in the predetermined time immediately after the proximitymanipulation is started and are detected as proximity areas at the timewhen the proximity is newly started, the control section 20 determinesthat the number of proximity areas through the proximity manipulation isplural.

That is, the control section 20 determines that one proximity area,which is detected when it is determined that the proximity manipulationis started, and one or plural proximity areas, which are newly detectedin the predetermined period immediately after the proximity manipulationis started, are proximity areas through the proximity manipulation whichis being performed at this time.

In this case, the control section 20 traces the plurality of proximityareas determined as the proximity areas through the proximitymanipulation until the proximity manipulation is terminated.

Further, for example, in a state where the proximity manipulation is notperformed, the control section 20 detects the plurality of proximityareas at the same time, determines that the proximity manipulation isstarted even when it is determined that these proximity areas are theproximity areas at the time when the proximity of the manipulation bodyis started, respectively, and then starts measurement of the proximitytime.

Further, in a similar way to the above-described case, the controlsection 20 detects the plurality of proximity areas through theproximity manipulation which is being performed at this time, and tracesthe detected plurality of proximity areas until the proximitymanipulation is terminated.

If the control section 20 starts the measurement of the proximity timeand detects and traces one or plural proximity areas through theproximity manipulation in this way, the control section 20 compares theproximity time with a predetermined time, for example, several seconds[sec] which is selected in advance for the continuous proximitymanipulation detection. Hereinafter, the continuous proximitymanipulation detection time is referred to as “continuous manipulationdetection time”

As a result, before the proximity time reaches the continuousmanipulation detection time, if it is determined that the traced one orplural proximity areas are the proximity areas at the time when theproximity is terminated, respectively, at this time, the control section20 determines that the manipulation body mistakenly moves close to thefirst manipulation surface and thus the proximity manipulation is notperformed.

That is, before the proximity time reaches the continuous manipulationdetection time, if the manipulation body deviates from the proximitydetection distance range from the first manipulation surface, thecontrol section 20 determines that the proximity manipulation is notperformed.

On the other hand, if the proximity time reaches the continuousmanipulation detection time, the control section 20 determines that theproximity manipulation which is currently being performed for the firstmanipulation surface at that time is the continuous proximitymanipulation.

Hereinafter, the time when it is determined that the proximitymanipulation which is being performed for the first manipulation surfaceis the continuous proximity manipulation is referred to as “continuousmanipulation detection time”.

Further, the control section 20 detects an indication region, indicatedby the continuous proximity manipulation, in the first manipulationsurface on the basis of the proximity area (one or plural proximityareas traced from the start of the proximity manipulation to thecontinuous manipulation detection time) through the continuous proximitymanipulation at the continuous manipulation detection time.

As shown in FIG. 7, in practice, if one proximity area CA2 through thecontinuous proximity manipulation is present, for example, the controlsection 20 detects the uppermost end point CA21, the lowermost end pointCA22, the leftmost end point CA23, and the rightmost end point CA24 inthe proximity area CA2.

Further, the control section 20 detects a rectangular area, whichincludes the proximity area CA2 and has sides each being in touch withthe uppermost, lowermost, leftmost and rightmost end points CA21, CA22,CA23 and CA24 which are detected in the proximity area CA2, as anindication region IA1.

On the other hand, as shown in FIG. 8, if the proximity areas CA3 andCA4 through the continuous proximity manipulation are plural, forexample, the control section 20 detects the uppermost end point CA41 andthe lowermost end point CA31 from the plurality of proximity areas CA3and CA4.

Further, for example, the control section 20 also detects the leftmostend point CA32 and the rightmost end point CA42 from the plurality ofproximity areas CA3 and CA4.

Further, the control section 20 detects a rectangular area, whichincludes all the plurality of proximity areas CA3 and CA4 and has sideseach being in touch with the uppermost, lowermost, leftmost andrightmost end points CA41, CA31, CA32 and CA42 which are detected in theplurality of proximity areas CA3 and CA4, as an indication region IA2.

In this way, if the indication regions IA1 and IA2 are detected, thecontrol section 20 detects the areas of the detected indication regionsIA1 and IA2.

At this time, for example, the control section 20 detects the areas ofthe indication regions IA1 and IA2 as the number of pixels positioned inportions, facing the indication regions IA1 and IA2, on the displaysurface of the first liquid crystal display panel 14A.

Here, for example, a detection table for detecting the enlargementtarget portion and the enlargement ratio (that is, the enlargementtarget portion which is part of the image, and its enlargement ratio)indicated by the continuous proximity manipulation on the basis of theareas of the indication regions IA1 and IA2 is stored in advance in thenon-volatile memory 21.

As shown in FIG. 9, a plurality of pieces of area information SR, whichindicates a plurality of areas which is selected in advance from theminimum area to the maximum area as the number of pixels, respectively,is stored in a detection table DT.

The minimum area is selected to be suitable for the area of the smallestindication region, which can be indicated by using a thin object such asa touch pen which is an example of the manipulation body when thecontinuous proximity manipulation is performed.

Further, the maximum area is selected as a predetermined area equal toor smaller than the entire display surface of the first liquid crystaldisplay panel 14A or the second liquid crystal display panel 15A.Further, the plurality of areas to the maximum area from the minimumarea is predetermined so as to be sequentially different from each otherin the unit of a pixel.

Further, for example, a plurality of pieces of enlargement targetportion information SZ, which is associated with the plurality of piecesof area information SR and indicates the size of the enlargement targetportion in a case where the enlargement target portion of a rectangularshape having the same aspect ratio as that of the display surface has anarea indicated by the area information SR as a rectangular frame, isalso stored in the detection table DT.

Further, for example, a plurality of pieces of enlargement ratioinformation ER, which is associated with the plurality of pieces ofenlargement target portion information SZ and indicates an enlargementratio in a case where the enlargement target portion having a sizeindicated by the enlargement target portion information SZ is enlargedto become the size of the entire display surface, is also stored in thedetection table DT.

That is, the enlargement ratio indicated by each piece of enlargementratio information ER is selected to enlarge any correspondingenlargement target portion into the same size as the size of the entiredisplay surface of the first liquid crystal display panel 14A (secondliquid crystal display panel 15A).

Accordingly, as shown in FIG. 10, with respect to the enlargement ratioindicated by each piece of enlargement ratio information ER, theenlargement ratio corresponding to the enlargement target portion of theminimum area becomes the maximum, and the corresponding enlargementratio is decreased as the area of the enlargement target portion isincreased. Thus, the enlargement ratio corresponding to the enlargementtarget portion of the maximum area becomes the minimum.

If the areas of the indication regions IA1 and IA2 are detected, thecontrol section 20 reads out the detection table DT in the RAM 22 fromthe non-volatile memory 21.

At this time, the control section 20 searches the area information SRindicating the same areas as the areas of the indication regions IA1 andIA2 from among the plurality of pieces of area information SR stored inthe detection table DT.

Further, the control section 20 searches the enlargement target portioninformation SZ corresponding to the searched area information SR in thedetection table DT, as enlargement target portion information SZindicating the enlargement target portion indicated by the continuousproximity manipulation at this time.

Further, the control section 20 searches the enlargement ratioinformation ER corresponding to the searched enlargement target portioninformation SZ in the detection table DT, as enlargement ratioinformation ER indicating the enlargement ratio indicated by thecontinuous proximity manipulation at this time.

Thus, the control section 20 reads out the enlargement target portioninformation SZ and the enlargement ratio information ER searched on thebasis of the areas of the indication regions IA1 and IA2 from thenon-volatile memory 21.

In addition, the control section 20 detects center positions of theindication regions IA1 and IA2 at this time as coordinates of the pixelpositions.

Further, as shown in FIGS. 11A and 11B, the control section 20 importsimages 35 and 36 which are displayed on the first liquid crystal displaypanel 14A at this time.

Further, the control section 20 matches center positions of framesindicated by the searched enlargement target portion information SZ withthe positions corresponding to the center positions CP1 and CP2 of theindication regions IA1 and IA2 in the images 35 and 36, to therebyoverlap the frames with the images 35 and 36.

In this way, the control section 20 specifies portions surrounded by theframes indicated by the searched enlargement target portion informationSZ in the images 35 and 36 which are being displayed on the first liquidcrystal display panel 14A, as enlargement target portions PE1 and PE2which are parts of the images 35 and 36.

Further, the control section 20 cuts out the specified enlargementtarget portions PE1 and PE2 from the images 35 and 36, and enlarges thecut-out enlargement target portions PE1 and PE2 at enlargement ratiosindicated by the searched enlargement ratio information ER.

Further, as shown in FIGS. 12 and 13, the control section 20 displaysenlarged images 40 and 41 obtained by enlarging the enlargement targetportions PE1 and PE2 on the entire display surface of the second liquidcrystal display panel 15A, instead of the images displayed on the secondliquid crystal display panel 15A thus far.

In this way, as shown in FIG. 14, for example, if the continuousproximity manipulation is performed by one finger which is themanipulation body for the first manipulation surface, the controlsection 20 can indicate the indication region IA1 which is relativelysmall in area according to one proximity area through the continuousproximity manipulation.

Further, if the area of the indication region IA1 is relatively small inthis way, the control section 20 can accordingly indicate the relativelysmall enlargement target portion PE1.

Further, if the indicated enlargement target portion PE1 is relativelysmall, the control section 20 can accordingly indicate an enlargementratio of a relatively large value, as the enlargement ratio for theenlargement target portion PE1.

On the other hand, as shown in FIGS. 15 and 16, for example, if thecontinuous proximity manipulation is performed by the plurality offingers for the first manipulation surface, the control section 20 canarbitrarily increase the number or interval of proximity areas at thetime of the continuous proximity manipulation.

Accordingly, as the number or interval of the proximity areas at thetime of the continuous proximity manipulation is increased, the controlsection 20 can indicate the indication regions IA2 and IA3 having largeareas.

Further, as the indicated enlargement target portions PE2 and PE3 becomelarger, the control section 20 can indicate enlargement ratios ofsmaller values.

However, if the enlarged images 40 and 41 are displayed, whenever thecontrol section 20 performs thereafter the area detection processes todetect one or plural proximity areas through the continuous proximitymanipulation, the control section 20 detects the indication regions andthe center positions of the indication regions on the basis of thedetected one or plural proximity areas, as described above.

Further, whenever the indication region and the center position thereofare detected through the continuous proximity manipulation after thecontinuous manipulation detection time, the control section 20 detects adistance (hereinafter, referred to as a “inter-center distance”) betweenthe detected center position and the center position of the indicationregion detected in the previous (one time before) area detectionprocess.

Further, whenever detecting the inter-center distance, the controlsection 20 compares the detected inter-center distance with apredetermined distance (hereinafter, referred to as a “movementmanipulation detection distance”) equal to or smaller than 1 [mm], forexample, which is set in advance for the proximity movement manipulationdetection.

As a result, if the inter-center distance is shorter than the movementmanipulation detection distance, the control section 20 determines thatthe proximity movement manipulation as the proximity manipulation is notperformed for the first manipulation surface.

In this way, while the continuous proximity manipulation is performedfrom the continuous manipulation detection time (while one or pluralproximity areas can be traced through the continuous proximitymanipulation), the control section 20 continuously displays theabove-described enlarged images 40 and 41 on the second liquid crystaldisplay panel 15A as they are.

On the other hand, if it is detected that the inter-center distance isequal to or longer than the movement manipulation detection distance(that is, the indication region is displaced by the movementmanipulation detection distance or longer), at this time, the controlsection 20 determines that the proximity movement manipulation isperformed as the proximity manipulation for the first manipulationsurface.

That is, if the indication region detected in the current area detectionprocess is displaced by the movement manipulation detection distance orlonger from the indication region detected in the previous areadetection process, the control section 20 determines that the proximitymanipulation which is currently being performed for the firstmanipulation surface is transited from the continuous proximitymanipulation to the proximity movement manipulation.

Hereinafter, the time when it is determined that the proximitymanipulation which is performed for the first manipulation surface isthe proximity movement manipulation is referred to as “movementmanipulation detection time”.

At this time, in a similar way to the above-described case, the controlsection 20 detects the indication region, indicated by the proximitymovement manipulation, in the first manipulation surface on the basis ofthe proximity area (one or plural proximity areas traced from the startof the proximity manipulation to the movement manipulation detectiontime) through the proximity movement manipulation at the time of themovement manipulation detection time.

Further, the control section 20 detects a center position of theindication region as coordinates of pixel positions, and matches acenter position of a frame searched at the continuous manipulationdetection time with a position corresponding to the center position inthe image which is being displayed on the first liquid crystal displaypanel 14A, to thereby overlap the frame with the image.

In this way, the control section 20 specifies a portion, surrounded withthe frame searched at the continuous manipulation detection time in theimage which is being displayed on the first liquid crystal display panel14A, as a new (that is, changed-position) enlargement target portionwhich is part of the image, on the basis of the indication regiondetected at this time.

Further, the control section 20 cuts out the newly specified enlargementtarget portion from the image, and enlarges the cut-out enlargementtarget portion at an enlargement ratio indicated at the continuousmanipulation detection time (that is, enlargement ratio indicated by theenlargement ratio information ER which is searched at the continuousmanipulation detection time).

Further, the control section 20 displays an enlarged image obtained byenlarging the enlargement target portion on the entire display surfaceof the second liquid crystal display panel 15A, instead of the enlargedimage displayed on the second liquid crystal display panel 15A thus far.

However, whenever the control section 20 performs the area detectionprocess after the movement manipulation detection time to detect one orplural proximity areas through the proximity movement manipulation, thecontrol section 20 detects the indication region and the center positionof the indication region on the basis of the detected one or pluralproximity areas, as described above.

Further, whenever the control section 20 detects the indication regionand the center position through the proximity movement manipulationafter the movement manipulation detection time, the control section 20detects the inter-center distance between the detected center positionand the center position of the indication region detected in theprevious (one time before) area detection process.

Further, whenever detecting the inter-center distance, the controlsection 20 compares the inter-center distance with the movementmanipulation detection distance. As a result, if the inter-centerdistance is equal to or longer than the movement manipulation detectiondistance, the control section 20 determines that the proximity movementmanipulation is still performed (the manipulation body moves over thefirst manipulation surface).

In this way, whenever performing the area detection process while theproximity movement manipulation is being performed for the firstmanipulation surface, the control section 20 sequentially detects theindication regions which are newly indicated by the proximity movementmanipulation, to thereby change enlargement target portions in theimage.

Further, the control section 20 sequentially enlarges the changedenlargement target portions at enlargement ratios indicated at thecontinuous manipulation detection time to generate enlarged images.

Further, as shown in FIGS. 17 and 18, the control section 20 displaysthe enlarged images 42 and 43 obtained by enlarging the enlargementtarget portions PE4 and PE5 on the second liquid crystal display panel15A, to thereby update the enlarged images 42 and 43 to be displayed onthe second liquid crystal display panel 15A.

However, when the enlargement target portion which is part of the imageis enlarged and displayed, the control section 20 does not allow theenlargement target portion to be directly indicated by bringing afinger, for example, in touch with the first manipulation surface, butallows the enlargement target portion to be indicated by moving thefinger, for example, close to the first manipulation surface.

Further, in the continuous proximity manipulation in which theenlargement target portion is indicated by moving the finger close tothe first manipulation surface, the enlargement target portion isroughly indicated according to the direction or the bending degree ofeach finger.

In particular, in the continuous proximity manipulation, in a case whereit is performed by the plurality of fingers for the first manipulationsurface, since the proximity by means of the plurality of fingers is notnecessarily performed with a constant bending degree or a constantpositional relationship according to the size or position of theenlargement target portion, the indication of the enlargement targetportion is more roughly performed.

Accordingly, in a case where the continuous proximity manipulation isperformed, the control section 20 detects a rectangular area includingone or plural proximity areas through the continuous proximitymanipulation as an indication region, and determines the enlargementtarget portion in the image which is displayed on the basis of theindication region.

In other words, the control section 20 has difficulty in correctlyspecifying the enlargement target portion in the image in the continuousproximity manipulation, and thus estimates the enlargement targetportion for detection.

For this reason, when the proximity movement manipulation is performedfor the first manipulation surface, even though the manipulation bodymoves in any direction of up, down, left and right directions over thefirst manipulation surface, the control section 20 sequentially detectsindication regions which are newly indicated by the proximity movementmanipulation, to thereby change the enlargement target portion in theimage.

Accordingly, when the proximity movement manipulation is performedsubsequent to the continuous proximity manipulation for the firstmanipulation surface, the control section 20 can arbitrarily change theenlargement target portion in the image according to the position of theindication region which is newly indicated by the proximity movementmanipulation.

That is, if subsequently the proximity movement manipulation isperformed while the enlargement target portion in the image is roughlyindicated by the continuous proximity manipulation, the control section20 accordingly changes the enlargement target portion, to therebycorrectly enlarge the desired enlargement target portion in the image tobe displayed.

Further, the control section 20 does not only use the proximity movementmanipulation to compensate for the rough indication of the enlargementtarget portion through the continuous proximity manipulation, but alsoto continuously confirm contents of a plurality of portions of arelatively fine image of a picture.

That is, as shown in FIGS. 19 and 20, for example, in a case where a mapimage 45 is displayed on the first liquid crystal display panel 14A, ifan enlargement target portion PE6 is indicated by the continuousproximity manipulation, the control section 20 enlarges the enlargementtarget portion PE6 and displays it on the second liquid crystal displaypanel 15A.

Further, at this time, if the proximity movement manipulation isperformed subsequent to the continuous proximity manipulation, thecontrol section 20 continuously changes and enlarges enlargement targetportions PE6 to PE9 in the map image 45, to thereby display them on thesecond liquid crystal display panel 15A.

In this way, even though the plurality of portions which a user desiresto confirm the contents exists in the image displayed on the firstliquid crystal display panel 14A are plural, the control section 20 caneasily confirm the contents of the plurality of portions with a simplemanipulation, without repeatedly performing the continuous proximitymanipulation for the first manipulation surface.

However, even though the enlargement target portion is appropriatelychanged according to the proximity movement manipulation, the controlsection 20 performs the area detection process and compares theinter-center distance with the movement manipulation detection distance,and as a result, if the inter-center distance is shorter than themovement manipulation detection distance, the control section 20determines that the proximity movement manipulation is transited to thecontinuous proximity manipulation.

At this time, the control section 20 displays the enlarged images 40 and41 which are generated at the time of the previous area detectionprocess on the second liquid crystal display panel 15A as they are.

Further, after it is determined that the proximity movement manipulationis transited to the continuous proximity manipulation, if the areadetection process is performed and one or plural proximity areas aretraced and detected through the area detection process (if themanipulation body moves close to the first manipulation surface), thecontrol section 20 determines that the continuous proximity manipulationis maintained.

Accordingly, the control section 20 continuously displays the enlargedimages 40 and 41 which are previously generated on the second liquidcrystal display panel 15A so that the enlargement target portion is notchanged according to the continuous proximity manipulation.

Here, even though it is determined that the proximity movementmanipulation is transited to the continuous proximity manipulation inthis way, thereafter, the control section 20 compares the inter-centerdistance with the movement manipulation detection distance whenever thearea detection process is performed.

As a result, if the inter-center distance is equal to or longer than themovement manipulation detection distance, the control section 20determines that the proximity manipulation which is being performed forthe first manipulation surface is again transited from the continuousproximity manipulation to the proximity movement manipulation.

In this way, if the continuous proximity manipulation is performed oncefor the first manipulation surface, thereafter, the control section 20appropriately enables the continuous proximity manipulation and theproximity movement manipulation to be alternately performed.

Further, even though it is determined that the continuous proximitymanipulation is performed, if all the proximity areas are not thereafterdetected through the continuous proximity manipulation without detectingthe touch area when the area detection process is performed, the controlsection 20 determines that the manipulation body is at a distance beyondthe proximity detection distance range from the first manipulationsurface.

That is, at this time, the control section 20 determines that thecontinuous proximity manipulation which is performed for the firstmanipulation surface is terminated. Accordingly, at this time, thecontrol section 20 also returns a display of the second liquid crystaldisplay panel 15A to the state before the enlarged image is displayed.

Further, in a case where it is determined that the proximity movementmanipulation is performed, if all the proximity areas are not thereafterdetected through the proximity movement manipulation without detectingthe touch area when the area detection process is performed, the controlsection 20 also determines that the manipulation body is at a distancebeyond the proximity detection distance range from the firstmanipulation surface.

That is, at this time, the control section 20 determines that theproximity movement manipulation which has been performed for the firstmanipulation surface is terminated. Accordingly, at this time, thecontrol section 20 returns a display of the second liquid crystaldisplay panel 15A to the state before the enlarged image is displayed.

In this way, by appropriately performing the continuous proximitymanipulation or the proximity movement manipulation for the firstmanipulation surface, the control section 20 can enlarge part of theimage which is being displayed on the first liquid crystal display panel14A and display it on the second liquid crystal display panel 15A.

However, if the indication item enlarged from the original size isincluded in the enlarged image displayed on the second liquid crystaldisplay panel 15A, the control section 20 detects the display area ofthe indication item in the second liquid crystal display panel 15A ascoordinates of the image position.

Further, the control section 20 matches the display area of the detectedindication item with a command allocated to the indication item.

If the proximity movement manipulation is performed to change theenlargement target portion, and thus the display area of the indicationitem is displaced, the control section 20 changes the display areamatched with the command allocated to the indication item to a displayarea after transition.

Thus, if it is detected that the tap manipulation is performed on thesecond manipulation surface of the second touch panel 15B in a statewhere the enlarged image is displayed on the second liquid crystaldisplay panel 15A, the control section 20 detects a display areaincluding the tap indication position from within the display area ofthe indication item.

Further, on the basis of the detected display area, the control section20 determines that the command matched with the display area is acommand input by the tap manipulation performed on the secondmanipulation surface of the second touch panel 15B at this time.

In this way, if it is determined that the command matched with thedisplay area is the command input by the tap manipulation on the secondmanipulation surface of the second touch panel 15B, the control section20 performs a process according to the determined command.

Here, if the command input by the tap manipulation at this time is acommand indicating a process which does not involve switching of theimage to be displayed, the control section 20 performs the processaccording to the command in a state where the enlarged image isdisplayed on the second liquid crystal display panel 15A.

On the other hand, if the command input by the tap manipulation is acommand indicating a process which involves switching of the image to bedisplayed, the control section 20 performs the process according to thecommand and displays a different image obtained according to the processwithout enlargement on the second liquid crystal display panel 15A,instead of the enlarged image.

For example, if the command input by the tap manipulation at this timeis a command for obtaining the above-described page data, the controlsection 20 displays the web browser image and the page image on thesecond liquid crystal display panel 15A without enlargement whilereceiving the page data from a server.

Further, if a sliding manipulation is performed for the manipulationsurface of the second touch panel 15B in a state where another image isdisplayed on the second liquid crystal display panel 15A in this way,accordingly, the control section 20 appropriately scrolls the differentimage displayed on the second liquid crystal display panel 15A.

Thus, even in a case where the entire different image is unable to bedisplayed for the second liquid crystal display panel 15A, the controlsection 20 can display the entire different image.

In this way, in a state where the different image is displayed on thesecond liquid crystal display panel 15A without enlargement instead ofthe enlarged image, if the continuous proximity manipulation or theproximity movement manipulation performed for the first manipulationsurface is terminated, the control section 20 returns the display of thesecond liquid crystal display panel 15A to the original state.

That is, at this time, instead of the different image, the controlsection 20 again displays the image which has been displayed immediatelybefore the continuous proximity manipulation or the proximity movementmanipulation is performed, on the second liquid crystal display panel15A.

Further, while the continuous proximity manipulation or the proximitymovement manipulation is being performed for the first manipulationsurface, even though the manipulation body is in touch with an area inthe first manipulation surface, which is different from the proximityarea through the continuous proximity manipulation or the proximitymovement manipulation, the control section 20 does not perform thedetection of the type of the touch manipulation.

Thus, while the continuous proximity manipulation or the proximitymovement manipulation is being performed for the first manipulationsurface, even though the manipulation body is mistakenly in touch withthe first manipulation surface, the control section 20 prevents adifferent image from being displayed, instead of the image which isbeing displayed, on the first liquid crystal display panel 14A due tothe mistaken touch.

That is, while the continuous proximity manipulation or the proximitymovement manipulation is being performed for the first manipulationsurface, even though the manipulation body is mistakenly in touch withthe first manipulation surface, the control section 20 prevents thecontinuous proximity manipulation or the proximity movement manipulationfrom being carelessly stopped due to the mistaken touch.

However, when the panel output signal is obtained from the second touchpanel 15B to detect the proximity area and the center position in thearea detection process, the control section 20 also performs the sameprocess as the process for detecting the type of the proximitymanipulation performed for the first manipulation surface.

Thus, the control section 20 can detect that the continuous proximitymanipulation or the proximity movement manipulation is performed for thesecond manipulation surface of the second touch panel 15B.

Further, if the continuous proximity manipulation or the proximitymovement manipulation is performed for the second manipulation surfaceof the second touch panel 15B, the control section 20 detects theenlargement target portion in the image which is being displayed on thesecond liquid crystal display panel 15A, by performing theabove-described process.

Further, at this time, as described above, the control section 20enlarges the enlargement target portion and displays the obtainedenlarged image on the first liquid crystal display panel 14A.

In this way, even though the continuous proximity manipulation or theproximity movement manipulation is performed for the second manipulationsurface of the second touch panel 15B, accordingly, the control section20 can display the enlarged enlargement target portion on the firstliquid crystal display panel 14A.

Further, if the tap manipulation is performed on the first manipulationsurface of the first touch panel 14B in a state where the enlarged imageis displayed on the first liquid crystal display panel 14A, the controlsection 20 appropriately switches the image to be displayed on the firsttouch panel 14B as described above.

Further, since the control section 20 can perform the proximitymanipulation for the second manipulation surface of the second touchpanel 15B in this way, for example, a user can appropriately perform theproximity manipulation to display the enlarged image while showing adisplay surface in a normal posture to a different user who faces theuser.

Further, if a different image is displayed on the first liquid crystaldisplay panel 14A instead of the enlarged image and the tap manipulationor the sliding manipulation is performed on the first manipulationsurface of the first touch panel 14B, the control section 20appropriately switches the image displayed on the first touch panel 14Bas described above and scrolls it.

[1-2-4. Display Control Process Routine]

Next, a display control process routine RT1, which enlarges part of animage in response to a proximity manipulation performed over the firstmanipulation surface of the first touch panel 14B or the secondmanipulation surface of the second touch panel 15B by the controlsection 20 and displays it, will be described with reference to FIGS. 21and 22.

For example, if the mobile terminal 10 starts up and an image isdisplayed on the first liquid crystal display panel 14A or the secondliquid crystal display panel 15A, the control section 20 starts thedisplay control process routine RT1 shown in FIGS. 21 and 22 accordingto a display control program which is stored in advance in thenon-volatile memory 21.

If the display control process routine RT1 is started, the controlsection 20 starts a regular area detection process and determines instep SP1 whether a proximity area is detected on the first manipulationsurface of the first touch panel 14B or the second manipulation surfaceof the second touch panel 15B.

If a negative result is obtained in step SP1, this means that themanipulation body has not yet moved close to any one of the firstmanipulation surface and the second manipulation surface, or that themanipulation body once moves close to and then away from themanipulation surface. If such a negative result is obtained in step SP1,the control section 20 moves the routine to the next step SP2.

In step SP2, the control section 20 determines whether a touch area isdetected on the first manipulation surface of the first touch panel 14Bor the second manipulation surface of the second touch panel 15B.

If a negative result is obtained in step SP2, this means that themanipulation body is not in touch with any one of the first manipulationsurface and the second manipulation surface. If such a negative resultis obtained in step SP2, the control section 20 moves the routine to thenext step SP3.

In step SP3, the control section 20 determines whether to terminate thedisplay of the image on the first liquid crystal display panel 14A andthe second liquid crystal display panel 15A.

If a negative result is obtained in step SP3, this means that anindication for display termination is not given and the image is stillcontinuously displayed on the first liquid crystal display panel 14A orthe second liquid crystal display panel 15A. If such a negative resultis obtained in step SP3, the control section 20 returns the routine tostep SP1.

Then, the control section 20 repeatedly performs the processes of stepsSP1 to SP3 until a positive result is obtained in any one of steps SP1to SP3.

Thus, the control section 20 waits for the proximity or touch of themanipulation body on the first manipulation surface of the first touchpanel 14B or the second manipulation surface of the touch panel 15B andtermination of the image display.

On the other hand, if a positive result is obtained in step SP2, thismeans that the manipulation body is in touch with the first manipulationsurface of the first touch panel 14B or the second manipulation surfaceof the second touch panel 15B and there is a possibility that the touchmanipulation is started. If such a positive result is obtained in stepSP2, the control section 20 moves the routine to the next step SP4.

In step SP4, the control section 20 determines whether a touchmanipulation is performed on the first manipulation surface or thesecond manipulation surface.

If a negative result is obtained in step SP4, this means, for example,that the manipulation body is in touch with a plurality of locations ofthe first manipulation surface or the second manipulation surface andthe tap manipulation or sliding manipulation as the touch manipulationis not performed. If such a negative result is obtained in step SP4, thecontrol section 20 returns the routine to step SP3.

On the other hand, if a positive result is obtained in step SP4, thismeans that the manipulation body is in touch with one location of thefirst manipulation surface or the second manipulation surface and thereis a possibility that the tap manipulation or sliding manipulation asthe touch manipulation is performed. If such a positive result isobtained in step SP4, the control section 20 moves the routine to thenext step SP5.

In step SP5, the control section 20 determines whether a command isinput by the touch manipulation. If a negative result is obtained instep SP5, this means that the determination of whether the touchmanipulation is the tap manipulation or the sliding manipulation is notyet completed, for example.

Alternatively, if the negative result is obtained in step SP5, thismeans, for example, that part of the image being displayed on the firstliquid crystal display panel 14A or the second liquid crystal displaypanel 15A, which is different from the display area of the indicationitem, is indicated by the tap manipulation. If such a negative result isobtained in step SP5, the control section 20 returns the routine to stepSP3.

On the other hand, if a positive result is obtained in step SP5, thismeans that the display area of the indication item in the image beingdisplayed is indicated by the tap manipulation performed on the firstmanipulation surface or the second manipulation surface and a commandcorresponding to the indication item is input.

Alternatively, if the positive result is obtained in step SP5, thismeans that a scroll command for the image being displayed is input bythe sliding manipulation performed on the first manipulation surface orthe second manipulation surface. If such a positive result is obtainedin step SP5, the control section 20 moves the routine to the next stepSP6.

In step SP6, the control section 20 performs a process according to thecommand input by the tap manipulation or the sliding manipulation, andthen returns the routine to step SP3.

In this way, the control section 20 appropriately switches the imagedisplayed on the first liquid crystal display panel 14A or the secondliquid crystal display panel 15A and appropriately changes a displayedportion of the image.

On the other hand, if a positive result is obtained in theabove-described step SP1, this means that the manipulation body movesclose to one of the first manipulation surface of the first touch panel14B and the second manipulation surface of the second touch panel 15B.

If such a positive result is obtained in step SP1, the control section20 determines that the proximity manipulation is started, and startsmeasurement of the proximity time. Then, the control section 20 movesthe routine to the next step SP7.

In step SP7, the control section 20 compares the proximity time with thecontinuous manipulation detection time, and determines whether theproximity time reaches the continuous manipulation detection time.

If a negative result is obtained in step SP7, this means that theproximity time has not yet reached the continuous manipulation detectiontime. If such a negative result is obtained in step SP7, the controlsection 20 returns the routine to step SP1.

Thus, the control section 20 waits until the proximity time reaches thecontinuous manipulation detection time by sequentially and repeatedlyperforming the processes of steps SP1 to SP7 while the manipulation bodyis close to the first manipulation surface or the second manipulationsurface.

On the other hand, if a positive result is obtained in step SP7, thismeans that a continuous proximity manipulation as the proximitymanipulation is performed for one of the first manipulation surface andthe second manipulation surface. If such a positive result is obtainedin step SP7, the control section 20 moves the routine to the next stepSP8.

In step SP8, the control section 20 detects an indication regionindicated by the continuous proximity manipulation and the area of theindication region.

Further, the control section 20 detects an enlargement target portion inthe image being displayed on one of the first liquid crystal displaypanel 14A and the second liquid crystal display panel 15A on the basisof the indication region and its area, and detects an enlargement ratiowith respect to the enlargement target portion. Then, the controlsection moves the routine to the next step SP9.

In step SP9, the control section 20 enlarges the enlargement targetportion at the enlargement ratio according to the area of the indicationregion, and displays it on the other of the first liquid crystal displaypanel 14A and the second liquid crystal display panel 15A. Then, thecontrol section 20 moves the routine to the next step SP10.

In step SP10, the control section 20 determines whether the proximityarea by means of the proximity manipulation (in this case, continuousproximity manipulation) is traced and detected.

If a positive result is obtained in step SP10, this means that themanipulation body is still close to one of the first manipulationsurface and the second manipulation surface. If such a positive resultis obtained in step SP10, the control section 20 moves the routine tothe next step SP11.

In step SP11, the control section 20 detects again an indication regionindicated by the continuous proximity manipulation and determineswhether this detected indication region is displaced by a movementmanipulation detection distance or further from the previously detectedindication region.

If a negative result is obtained in step SP11, this means that themanipulation body is close to one of the first manipulation surface andthe second manipulation surface while being hardly moved. If such anegative result is obtained in step SP11, the control section 20 movesthe routine to step SP12.

In step SP12, the control section 20 determines whether the touch areais detected on the other of the first manipulation surface and thesecond manipulation surface.

If a negative result is obtained in step SP12, this means that themanipulation body is not in touch with the other of the firstmanipulation surface and the second manipulation surface. If such anegative result is obtained in step SP12, the control section 20 returnsthe routine to step SP10.

Then, the control section 20 repeatedly performs the processes of stepsSP10 to SP12 until a negative result is obtained in step SP10 or apositive result is obtained in any one of steps SP11 and SP12.

Thus, the control section 20 waits for termination of the proximitymanipulation or start of the proximity movement manipulation, andindication of the indication item in the enlarged image.

On the other hand, if a positive result is obtained in step SP11, thismeans that the proximity movement manipulation is performed over one ofthe first manipulation surface and the second manipulation surface,subsequent to the continuous proximity manipulation. If such a positiveresult is obtained in step SP11, the control section 20 moves theroutine to the next step SP13.

In step SP13, the control section 20 detects the indication regionindicated by the proximity movement manipulation and the area of theindication region.

Further, the control section 20 changes and detects the enlargementtarget portion in the image being displayed on one of the first liquidcrystal display panel 14A and the second liquid crystal display panel15A on the basis of the indication region and its area. Then, thecontrol section 20 moves the routine to the next step SP14.

In step SP14, the control section 20 enlarges the enlargement targetportion after change at an enlargement ratio according to the area ofthe indication region indicated by the continuous proximity manipulationand its area and displays it on the other of the first liquid crystaldisplay panel 14A and the second liquid crystal display panel 15A. Then,the control section 20 returns the routine to step SP10.

Thus, the control section 20 changes the enlargement target portion inthe image being displayed and enlarges the changed enlargement targetportion to be displayed while the manipulation body which is close toone of the first manipulation surface and the second manipulationsurface is moved while maintaining the proximity state.

Further, if a positive result is obtained in step SP12, this means thatthe manipulation body is in touch with the other of the firstmanipulation surface and the second manipulation surface and there is apossibility that a tap manipulation is started. If such a positiveresult is obtained in step SP12, the control section 20 moves theroutine to the next step SP15.

In step SP15, the control section 20 determines whether a touchmanipulation is performed on the other of the first manipulation surfaceand the second manipulation surface.

If a negative result is obtained in step SP15, this means, for example,that the manipulation body is in touch with a plurality of locations inthe other of the first manipulation surface and the second manipulationsurface but the touch manipulation is not performed. If such a negativeresult is obtained in step SP15, the control section 20 returns theroutine to step SP10.

On the other hand, if a positive result is obtained in step SP15, thismeans that the manipulation body is in touch with a single location inthe other of the first manipulation surface and the second manipulationsurface and the touch manipulation is performed.

If such a positive result is obtained in step SP15, the control section20 starts measurement of the touch time, and then moves the routine tothe next step SP16.

In step SP16, the control section 20 determines whether the touchmanipulation performed on the other of the first manipulation surfaceand the second manipulation surface at this time is a tap manipulation.

If a negative result is obtained in step SP16, this means that the touchtime is in the middle of being measured in a tap detection time and thedetermination concerning whether the touch manipulation is the tapmanipulation is not yet terminated.

Alternatively, if the negative result is obtained in step SP16, thismeans that the touch time being measured exceeds the tap detection timeand thus the manipulation body is mistakenly in touch with the other ofthe first manipulation surface and the second manipulation surface atthis time. If such a negative result is obtained in step SP16, thecontrol section 20 returns the routine to step SP10.

On the other hand, if a positive result is obtained in step SP16, thismeans that the manipulation body is in touch with nearly a single pointin the other of the first manipulation surface and the secondmanipulation surface within the tap detection time and then isdisengaged from it immediately thereafter. If such a positive result isobtained in step SP16, the control section 20 moves the routine the nextstep SP17.

In step SP17, the control section 20 determines whether a display areaof the indication item in the enlarged image is indicated by the tapmanipulation.

If a negative result is obtained in step SP17, this means that a portionwhich is different from the display area of the indication item in theenlarged image is indicated by the tap manipulation and the manipulationbody is mistakenly in touch with the other of the first manipulationsurface and the second manipulation surface at this time. If such anegative result is obtained in step SP17, the control section 20 returnsthe routine to step SP10.

On the other hand, if a positive result is obtained in step SP17, thismeans that the display area of the indication item in the enlarged imageis indicated by the tap manipulation and a command corresponding to theindication item is input. If such a positive result is obtained in stepSP17, the control section 20 moves the routine to the next step SP18.

In step SP18, the control section 20 performs a process for displaying adifferent image, instead of the enlarged image, on the other of thefirst liquid crystal display panel 14A and the second liquid crystaldisplay panel 15A, for example, according to the command input as theindication item is indicated by the tap manipulation, and then returnsthe routine to step SP10.

In this way, the control section 20 appropriately changes the enlargedimage displayed on the other of the first liquid crystal display panel14A and the second liquid crystal display panel 15A together with theenlargement target portion, by sequentially performing the processes ofsteps SP10 to SP18. Then, the control section 20 performs a processaccording to the indication item in the enlarged image.

Further, if a negative result is obtained in step SP10, this means thatthe manipulation body which has been in proximity to one of the firstmanipulation surface and the second manipulation surface moves awaybeyond the proximity detection distance range and the proximitymanipulation is terminated.

If such a negative result is obtained in step SP10, the control section20 returns the enlarged image displayed on the other of the first liquidcrystal display panel 14A and the second liquid crystal display panel15A to an image before the enlarged image is displayed, and then returnsthe routine to step SP2.

In this way, the control section 20 enlarges part of the image at anenlargement ratio according to the area of the indication regionindicated by the continuous proximity manipulation and displays it, byperforming the processes of steps SP1 to SP18 while the image is beingdisplayed on the first liquid crystal display panel 14A or the secondliquid crystal display panel 15A.

On the other hand, if a positive result is obtained in step SP3, thismeans that an indication is given so that the image display on the firstliquid crystal display panel 14A and the second liquid crystal displaypanel 15A is terminated.

If such a positive result is obtained in step SP3, the control section20 completely terminates the image display on the first liquid crystaldisplay panel 14A and the second liquid crystal display panel 15A, andthen moves the routine to the next step SP19. Then, in step SP19, thecontrol section 20 terminates the display control process routine RT1.

[1-2-5. Operation and Effect of Embodiment]

In the above-described configuration, if the continuous proximitymanipulation is performed for the surface (first or second manipulationsurface) of one of the first touch screen 14 and the second touch screen15 on which the image is displayed, the control section 20 of the mobileterminal 10 detects the indication region through the continuousproximity manipulation and its area.

Further, the control section 20 detects the enlargement target portionwhich is part of the image being displayed on one of the first touchscreen 14 and the second touch screen 15 on the basis of the indicationregion and the area, and detects the enlargement ratio for theenlargement target portion on the basis of the area of the indicationregion.

Then, the control section 20 enlarges the enlargement target portion atan enlargement ratio according to the area of the indication region anddisplays it on the other of the first touch screen 14 and the secondtouch screen 15.

Thus, the control section 20 can allow a desired enlargement targetportion to be selected by the indication region according to thecontinuous proximity manipulation, for example, by arbitrarily changingthe number of fingers which are the manipulation body, intervals of theindividual fingers or the like when the continuous proximitymanipulation is performed.

Further, at this time, the control section 20 can arbitrarily select thearea of the indication region through the continuous proximitymanipulation and the enlargement ratio for the enlargement targetportion by arbitrarily changing the number of fingers which are themanipulation body, intervals of the individual fingers or the like whenthe continuous proximity manipulation is performed.

That is, the control section 20 can easily select the enlargement targetportion in the image and a desired enlargement ratio for the enlargementtarget portion by the continuous proximity manipulation by arbitrarilyadjusting the size of the proximity area by means of the continuousproximity manipulation, the number of proximity areas, the positionalrelationship between the plurality of proximity areas, or the like.

Further, the control section 20 can enlarge the enlargement targetportion in the image being displayed on one of the first touch screen 14and the second touch screen 15 with a desired size at the selectedenlargement ratio, and can display it on the other of the first touchscreen 14 and the second touch screen 15.

According to the above-described configuration, when the continuousproximity manipulation is performed for the surface of one of the firsttouch screen 14 and the second touch screen 15 by the manipulation body,the control section 20 of the mobile terminal 10 detects the area of theindication region indicated by the continuous proximity manipulation andenlarges the enlargement target portion which is part of the image atthe enlargement ratio according to the detected area of the indicationregion to be displayed on the other of the first touch screen 14 and thesecond touch screen 15.

Thus, the control section 20 of the mobile terminal 10 can easily selectpart of the image which is the enlargement target portion by thecontinuous proximity manipulation and a desired enlargement ratio forthe part of the image and can enlarge the part of the image with adesired size to be displayed on the other of the first touch screen 14and the second touch screen 15. Accordingly, the control section 20 ofthe mobile terminal 10 can significantly enhance usability of the mobileterminal 10.

If the proximity movement manipulation is performed for the surface ofone of the first touch screen 14 and the second touch screen 15 on whichthe image is being displayed in succession to the continuous proximitymanipulation, the control section 20 of the mobile terminal 10 changesthe enlargement target portion in the image.

Further, the control section 20 of the mobile terminal 10 enlarges thechanged enlargement target portion and displays it on the other of thefirst touch screen 14 and the second touch screen 15, instead of theprevious enlargement target portion.

Thus, the control section 20 of the mobile terminal 10 can easily changeand enlarge the enlargement target portion of the image to be displayed,through a simple manipulation for moving the manipulation body which hasbeen in proximity to one of the first manipulation surface and thesecond manipulation surface while maintaining the proximity state,without repeatedly performing the continuous proximity manipulation.

Further, if the continuous proximity manipulation or the proximitymovement manipulation is performed for the surface of one of the firsttouch screen 14 and the second touch screen 15, the control section 20of the mobile terminal 10 displays part of the image displayed thereonon the other of the first touch screen 14 and the second touch screen15.

Thus, the control section 20 of the mobile terminal 10 can show theenlarged image without any interruption due to the manipulation bodywhich performs the continuous proximity manipulation or the proximitymovement manipulation.

Further, the control section 20 of the mobile terminal 10 enlarges partof the image according to the continuous proximity manipulation or theproximity movement manipulation performed by moving the manipulationbody close to the surface of one of the first touch screen 14 and thesecond touch screen 15 while maintaining the proximity without touch,and displays it.

Thus, the control section 20 of the mobile terminal 10 can allow theenlargement ratio for part of the image and the enlargement display tobe indicated by an intuitive manipulation which is the same as a touchmanipulation, which is obviously distinguished from the touchmanipulation such as a tap manipulation or sliding manipulation.

2. Modified Embodiments 2-1. First Modified Embodiment

In the above-described embodiment, from among values of the enlargementratio which is in inverse proportion to the size of the area of theindication region detected according to the continuous proximitymanipulation, in which the values become smaller as the area becomeslarger, an enlargement ratio for enlarging the enlargement targetportion is detected according to the area. Further, in theabove-described embodiment, the enlargement target portion is enlargedat the detected enlargement ratio.

However, the present invention is not limited thereto. For example, fromamong values of the enlargement ratio which is in proportion to the sizeof the area of the indication region detected according to thecontinuous proximity manipulation, in which the values become larger asthe area becomes larger, the enlargement ratio for enlarging theenlargement target portion is detected according to the area. Further,in this modified embodiment, the enlargement target portion may beenlarged at the detected enlargement ratio.

According to such a configuration, in this modified embodiment, if anindication region of a relatively small area is indicated as a singlefinger which is an example of the manipulation body moves close to thefirst manipulation surface of the first touch panel 14B or the secondmanipulation surface of the second touch panel 15B, it is possible toselect an enlargement ratio of a small value.

Further, according to such a configuration, in this modified embodiment,if an indication region of a relatively large area is indicated as aplurality of fingers which is an example of the manipulation body movesclose to the first manipulation surface or the second manipulationsurface with these fingers being put together or separated from eachother, it is possible to select an enlargement ratio of a large value.

In other words, according to such a configuration, in this modifiedembodiment, since the enlargement ratio is increased as the area of theindication region indicated by moving the manipulation body close to thefirst manipulation surface or the second manipulation surface isincreased, it is possible to intuitively recognize and select the valueof the enlargement ratio by the area of the indication region.

In the case of such a configuration, in this modified embodiment,enlargement ratios having different values may correspond to a pluralityof areas, respectively, in a similar way to the above-describedembodiment.

However, in this modified embodiment, for example, the plurality ofareas, which ranges from the minimum area to the maximum area, issequentially divided into a specific range, and a single enlargementratio having a different value corresponds to each specific range.

Further, in this modified embodiment, when an indication region havingan area of the specific range is detected, even though the area is anyarea within the specific range, the enlargement target portion may beuniformly enlarged at a single enlargement ratio corresponding to thespecific range.

2-2. Second Modified Embodiment

In the above-described embodiment, if the continuous proximitymanipulation or the proximity movement manipulation is performed for thefirst manipulation surface of the first touch panel 14B or the secondmanipulation surface of the second touch panel 15B, the indicationregion and the area of the indication region are detected.

Further, in the above-described embodiment, a rectangular portion in theimage having the same area as the area of the indication region andhaving the same aspect ratio as an aspect ratio of the display surfaceis used as the enlargement target portion, and the enlargement targetportion is enlarged.

However, the present invention is not limited thereto. For example, ifthe continuous proximity manipulation or the proximity movementmanipulation is performed for the first manipulation surface or thesecond manipulation surface, the indication region itself in the imageor a portion therein having a variety of shapes such as a square shape,circular shape or the like, which has the same area as the area of theindication region, is used as the enlargement target portion.

Further, in this modified embodiment, the enlargement target portion maybe enlarged at an enlargement ratio according to the area of theindication region. With such a configuration, in this modifiedembodiment, it is also possible to obtain the same effect as that of theabove-described embodiment.

Further, in this modified embodiment, if the continuous proximitymanipulation or the proximity movement manipulation is performed for thefirst manipulation surface or the second manipulation surface, a portionhaving a specific size in the image is used as the enlargement targetportion, regardless of the area of the indication region.

Further, in this modified embodiment, a center position of the portionof the specific size is matched with a center position of the indicationregion, and the portion of the specific size is used as the enlargementtarget portion.

In this modified embodiment, in a case where the size of the enlargementtarget portion is constantly maintained, the enlargement target portionmay employ a variety of shapes such as a rectangular shape having thesame aspect ratio as the aspect ratio of the display surface, squareshape, circular shape or the like.

Further, in this modified embodiment, the enlargement target portion maybe enlarged at an enlargement ratio according to the area of theindication region. Accordingly, with such a configuration, in thismodified embodiment, it is possible to obtain the same effect as in theabove-described embodiment.

In addition, in this modified embodiment, if the continuous proximitymanipulation or the proximity movement manipulation is performed for thefirst manipulation surface or the second manipulation surface, a portionhaving a predetermined shape such as a square shape, circular shape orthe like, which has the same area as the area of the proximity area inthe image, is used as the enlargement target portion.

In this modified embodiment, at this time, if only one proximity area isdetected, the portion of the predetermined shape having the same area asthe area of the detected one proximity area is used as the enlargementtarget portion.

Further, in this modified embodiment, at this time, if the plurality ofproximity areas is detected, a portion of a predetermined shape havingthe same area as a total area of the plurality of proximity areas isused as the enlargement target portion.

Furthermore, in this modified embodiment, at this time, the centerposition of the portion of the predetermined shape is matched with thecenter position of the indication region, and the portion of thepredetermined shape is used as the enlargement target portion.

Further, in this modified embodiment, the enlargement target portion maybe enlarged at an enlargement ratio according to the area of theindication region. In this modified embodiment, with such aconfiguration, it is possible to obtain the same effect as in theabove-described embodiment.

However, in this modified embodiment, the enlargement target portion setby these various methods may be enlarged with a constant enlargementratio which is set in advance, instead of being enlarged at theenlargement ratio according to the area of the indication region.

According to such a configuration, in this modified embodiment, eventhough the enlargement ratio of the enlargement target portion isconstant, it is possible to arbitrarily select the position and size(that is, area) of the enlargement target portion, and to enlarge adesired portion in the image. Accordingly, with such a configuration, inthis modified embodiment, it is also possible to significantly enhanceusability of the mobile terminal.

Further, in this modified embodiment, it is possible to appropriatelyswitch the enlargement ratio according to the area of the indicationregion and such a constant enlargement ratio at which the enlargementtarget portion is enlarged.

According to such a configuration, in this modified embodiment, it ispossible to allow a user to arbitrarily select the method of imageenlargement, and to further enhance usability of the mobile terminal.

In addition, in this modified embodiment, the second modified embodimentwith respect to the size and shape of the enlargement target portion orits enlargement ratio may be combined with the configuration of thefirst modified embodiment with respect to the enlargement ratiocorresponding to the above-described area.

2-3. Third Modified Embodiment

In the above-described embodiment, if the continuous proximitymanipulation or the proximity movement manipulation is performed for thefirst manipulation surface of the first touch panel 14B or the secondmanipulation surface of the second touch panel 15B, the indicationregion and the area of the indication region are detected.

Further, in the above-described embodiment, the center position of therectangular frame, in the image, having the same aspect ratio as theaspect ratio of the display surface is overlapped to be matched with theposition facing the center position of the indication region, and theportion inside the frame is used as the enlarged target portion.

However, the present invention is not limited thereto. For example, ifthe continuous proximity manipulation or the proximity movementmanipulation is performed for the first manipulation surface or thesecond manipulation surface, regardless of the center position of theindication region, a same portion such as a center portion in the imagemay be used as the enlargement target portion, for example.

Further, in this modified embodiment, in a case where the same portionin the image is used as the enlargement target portion all the timeregardless of the center position of the indication region, for example,the enlargement target portion may be appropriately indicated and setaccording to the touch manipulation such as a tap manipulation orsliding manipulation for the first manipulation surface or the secondmanipulation surface.

In addition, in this modified embodiment, if the continuous proximitymanipulation or the proximity movement manipulation is performed for thefirst manipulation surface or the second manipulation surface, theenlargement is performed at the enlargement ratio according to the areaof the indication region using the entire image as the enlargementtarget portion.

Further, in this modified embodiment, at this time, by matching thecenter position of the enlarged image with the center position of thedisplay surface, or by matching the center position of the indicationregion with the center position of the enlarged image, the enlargedimage may be displayed.

Furthermore, in this modified embodiment, the configuration of the thirdmodified embodiment with respect to the image enlargement may becombined with the configuration of at least one of the above-describedfirst modified embodiment and second modified embodiment.

2-4. Fourth Modified Embodiment

In the above-described embodiment, the first touch screen 14 and thesecond touch screen 15 are installed in the mobile terminal 10.

Further, in the above-described embodiment, according to the proximitymanipulation for one of the first touch screen 14 and the second touchscreen 15, part of the image is enlarged and displayed on the other ofthe first touch screen 14 and the second touch screen 15.

However, the present invention is not limited thereto. As shown in FIG.23, for example, one touch screen 51 having the same configuration asthat of the above-described first touch screen 14 or second touch screen15 is installed in a mobile terminal 50.

Further, in this modified embodiment, if the proximity manipulation isperformed for a surface of the touch screen 51 in the mobile terminal50, part of the image 52 may be enlarged at an enlargement ratioaccording to the area of the indication region to be displayed on thetouch screen 51, instead of the image 52 displayed thus far.

Further, in this modified embodiment, in a case where the enlarged image53 is displayed on the touch screen 51 in the mobile terminal 50, eventhough the manipulation body moves away from the proximity detectiondistance range from the touch screen 51, the display of the enlargedimage 53 is maintained.

Furthermore, in this modified embodiment, if a specific type ofproximity manipulation or touch manipulation is performed for thesurface of the touch screen 51, in a state where the enlarged image 53is displayed on the touch screen 51 in the mobile terminal 50, theoriginal image 52 may be displayed instead of the enlarged image 53.

Further, in this modified embodiment, in a case where the enlarged imageis displayed on one of the first touch screen 14 and the second touchscreen 15, the display of the enlarged image is maintained even thoughthe manipulation body moves away from the other of the first touchscreen 14 and the second touch screen 15.

Further, in this modified embodiment, in a state where the enlargedimage is displayed, if a specific type of proximity manipulation ortouch manipulation is performed on the surface of one or the other ofthe first touch screen 14 and the second touch screen 15, the displaymay return to the original state.

Further, in this modified embodiment, at least one touch panel isseparately installed in the mobile terminal without being integratedwith at least one liquid crystal display panel.

In addition, in this modified embodiment, if the proximity manipulationis performed for the manipulation surface of the touch panel, part ofthe image may be enlarged and displayed on the liquid crystal displaypanel, at an enlargement ratio according to the area of the indicationregion indicated by the proximity manipulation.

In this modified embodiment, the configuration of the fourth modifiedembodiment with respect to the mobile terminal may be combined with theconfiguration of at least one of the above-described first modifiedembodiment, second modified embodiment and third modified embodiment.

2-5. Fifth Modified Embodiment

Further, in the above-described embodiment, while the continuousproximity manipulation is being performed for the first manipulationsurface of the first touch panel 14B or the second manipulation surfaceof the second touch panel 15B, the enlargement target portion of theimage is enlarged and displayed at an enlargement ratio indicated by thecontinuous proximity manipulation.

However, the present invention is not limited thereto. For example,while the continuous proximity manipulation is being performed for thefirst manipulation surface or the second manipulation surface, the areaof the indication region is detected whenever the area detection processis performed every time or once per every predetermined number of times.

Further, in this modified embodiment, while the continuous proximitymanipulation is being performed, whenever the area of the indicationregion is detected, the enlargement ratio according to the area isdetected to update the enlargement ratio used for enlargement of theenlargement target portion into the detected enlargement ratio.

In this way, in this modified embodiment, while the continuous proximitymanipulation is being performed, the enlargement target portion of theimage is appropriately enlarged and displayed at the updated enlargementratio.

Further, in this modified embodiment, while the proximity movementmanipulation is being performed for the first manipulation surface orthe second manipulation surface, similarly, the area of the indicationregion is detected whenever the area detection process is performedevery time or once per every predetermined number of times.

In addition, in this modified embodiment, while the proximity movementmanipulation is being performed, whenever the area of the indicationregion is detected, the enlargement ratio according to the area isdetected to update the enlargement ratio used for enlargement of theenlargement target portion into the detected enlargement ratio.

In this way, in this modified embodiment, while the proximity movementmanipulation is being performed, similarly, the enlargement targetportion of the image is appropriately enlarged and displayed at theupdated enlargement ratio.

In this modified embodiment, with such a configuration, by changing thedistance between the first manipulation surface or the secondmanipulation surface and the manipulation body during the proximitymanipulation, it is possible to freely change the enlargement ratio andto enlarge the enlargement target portion.

In addition, in this modified embodiment, while the continuous proximitymanipulation is being performed for the first manipulation surface orthe second manipulation surface, the area of the indication region maybe detected whenever the area detection process is performed every timeor once per every predetermined number of times, as well as theenlargement ratio, and the size of the enlargement target portion may bechanged on the basis of the area.

Further, in this modified embodiment, even while the proximity movementmanipulation is being performed for the first manipulation surface orthe second manipulation surface, similarly, the area of the indicationregion may be detected whenever the area detection process is performedevery time or once per every predetermined number of times, and the sizeof the enlargement target portion may be changed according to the area.

With such a configuration, in this modified embodiment, by changing thedistance between the first manipulation surface or the secondmanipulation surface and the manipulation body even during the proximitymanipulation, it is possible to freely change the size of theenlargement target portion as if zoom is performed, and to enlarge theenlargement target portion.

Further, in this modified embodiment, the change in the enlargementratio may be combined with the change in the size of the enlargementtarget portion.

However, in this modified embodiment, the configuration of the fifthmodified embodiment with respect to the update of the enlargement ratiomay be combined with the configuration of at least one of theabove-described first modified embodiment, second modified embodiment,third modified embodiment and fourth modified embodiment.

2-6. Sixth Modified Embodiment

Further, in the above-described embodiment, according to the continuousproximity manipulation or the proximity movement manipulation performedfor the first manipulation surface of the first touch panel 14B or thesecond manipulation surface of the second touch panel 15B, theenlargement target portion of the image is enlarged and displayed.

However, the present invention is not limited thereto. For example, theenlargement target portion of the image may be enlarged and displayedaccording to the touch manipulation such as a tap manipulation or asliding manipulation performed for the first manipulation surface or thesecond manipulation surface.

That is, in this modified embodiment, the indication region and its areamay be detected according to the tap manipulation performed by, forexample, one or plural fingers, for the first manipulation surface orthe second manipulation surface, and the enlargement target portion ofthe image may be enlarged and displayed at an enlargement ratioaccording to the area.

Further, in this modified embodiment, the indication region and its areamay be detected according to the sliding manipulation performed tosurround a desired portion as the indication region by, for example, onefinger, to the first manipulation surface or the second manipulationsurface, and the enlargement target portion of the image may be enlargedand displayed at an enlargement ratio according to the area.

Further, in this modified embodiment, the indication region and its areamay be detected according to the touch manipulation performed to bring,for example, one or plural fingers in touch with the first manipulationsurface or the second manipulation surface for a predetermined time orlonger, and the enlargement target portion of the image may be enlargedand displayed at an enlargement ratio according to the area.

However, in this modified embodiment, if the continuous proximitymanipulation is performed for the first manipulation surface or thesecond manipulation surface to detect the indication region and itsarea, it may be thereafter considered that the continuous proximitymanipulation is being performed even though the manipulation body is intouch with the first manipulation surface or the second manipulationsurface.

That is, in this modified embodiment, while the continuous proximitymanipulation is being performed, even though the manipulation body is intouch with the first manipulation surface or the second manipulationsurface to detect the touch area, the touch area is handled as theproximity area to detect the indication region.

Further, in this modified embodiment, the display of the enlarged imagefor one of the first liquid crystal display panel 14A and the secondliquid crystal display panel 15A may be continued.

Furthermore, in this modified embodiment, after the continuous proximitymanipulation is performed for the first manipulation surface or thesecond manipulation surface to detect the indication region and itsarea, even though the manipulation body is in touch with the firstmanipulation surface or the second manipulation surface in thecontinuously performed proximity movement manipulation, it may beconsidered that the proximity movement manipulation is being performed.

That is, in this modified embodiment, while the proximity movementmanipulation is being performed, even though the manipulation body is intouch with the first manipulation surface or the second manipulationsurface to detect the touch area, the touch area is handled as theproximity area to detect the indication region.

Further, in this modified embodiment, the display of the enlarged imagefor one of the first liquid crystal display panel 14A and the secondliquid crystal display panel 15A may be continued.

Further, in this modified embodiment, after the continuous proximitymanipulation is performed for the first manipulation surface or thesecond manipulation surface to detect the indication region and itsarea, even though the manipulation body is continuously manipulated tobe moved while being in touch with the first manipulation surface or thesecond manipulation surface, the manipulation may be considered as theproximity movement manipulation.

That is, in this modified embodiment, after the indication region andits area are detected according to the proximity movement manipulation,even though the touch area is detected until the manipulation body movesaway from the proximity detection distance range from the firstmanipulation surface or the second manipulation surface, the touch areais handled as the proximity area to detect the indication region.

Further, in this modified embodiment, the display of the enlarged imagefor one of the first liquid crystal display panel 14A and the secondliquid crystal display panel 15A may be continued.

With such a configuration, in this modified embodiment, even though themanipulation body is mistakenly in touch with the first manipulationsurface or the second manipulation surface while the continuousproximity manipulation or the proximity movement manipulation is beingperformed, it is possible to prevent a process for enlarging anddisplaying the enlargement target portion from being carelessly stoppeddue to the touch.

However, in this modified embodiment, the configuration of the sixthmodified embodiment with respect to the manipulation for enlarging anddisplaying the image may be combined with the configuration of at leastone of the above-described first modified embodiment, second modifiedembodiment, third modified embodiment, fourth modified embodiment andfifth modified embodiment.

2-7. Seventh Modified Embodiment

Further, in the above-described embodiment, in a state where theproximity area and the touch area are not detected at all, if oneproximity area is detected when the proximity is started, it isdetermined that the proximity manipulation is started, and then, it isdetected whether the continuous proximity manipulation is performed.

However, the present invention is not limited thereto. For example, ifone proximity area is detected when the proximity is started in a statewhere the proximity area and the touch area are not detected, it may bedetected whether the continuous proximity manipulation is performedaccording to the detection situation of the proximity area thereafter,without determining the start of the proximity manipulation.

Further, hereinafter, with respect to the method of detecting whethersuch a continuous proximity manipulation is performed, a case where themanipulation body is in proximity to the first manipulation surface ofthe first touch panel 14B will be described as an example.

That is, if one proximity area is detected when the proximity is startedin a state where the proximity area and the touch area are not detectedat all, the control section 20 starts measurement of the proximity timeby a timer.

Further, if a plurality of proximity areas is simultaneously detectedwhen the proximity is started in a state where the proximity area andthe touch area are not detected at all, the control section 20 startsmeasurement of the proximity time by the timer.

Further, if the measurement of the proximity time is started, thecontrol section 20 continues to measure the proximity time until theproximity time reaches the continuous manipulation detection time atmaximum.

Further, if one or plural proximity areas are detected when theproximity is started in this way, the control section 20 also startsdetection of the movement trace of each finger which is an example ofthe manipulation body using the center position of the proximity area asa starting point of each movement trace.

Furthermore, for example, if one or plural fingers newly move close tothe first manipulation surface to additionally detect one or pluralproximity areas when the proximity is started until the proximity timereaches the continuous manipulation detection time, the control section20 also uses the center position of the one or plural proximity areas asthe starting point of each movement trace.

Further, in the case where one or plural proximity areas areadditionally detected in this way, the control section 20 startsdetection of the movement trace of each finger which is an example ofthe additionally detected manipulation body in a similar way.

Further, whenever the control section 20 detects the proximity area andits center position by performing the area detection process after oneor plural proximity areas are detected when the proximity is started,the control section 20 sequentially traces the detected center positionfrom the starting point (center position), to thereby detect themovement trace of each finger.

Further, even though one or plural fingers are disengaged from the firstmanipulation surface before the proximity time reaches the continuousmanipulation detection time and the proximity area of the finger is notdetected (even though the number of the detected proximity areas isdecreased), if one or more proximity areas are still detected, thecontrol section 20 continues to measure the proximity time.

Here, if all the proximity areas are unable to be detected before theproximity time reaches the continuous manipulation detection time (thatis, if all the fingers which are an example of the manipulation bodywhich are close to the first manipulation surface are deviated from theproximity detection distance range), the control section 20 terminatesthe measurement of the proximity time.

Further, if one or plural fingers come in touch with the firstmanipulation surface before the proximity time reaches the continuousmanipulation detection time to detect one or plural touch areas, at thistime, the control section 20 terminates the measurement of the proximitytime, regardless of the presence or absence of the detection of theproximity area.

In this way, if the measurement of the proximity time is started, whileat least one proximity area is being detected to be sequentially tracedin a state where the touch area is not detected, the control section 20continues to measure the proximity time.

That is, if the measurement of the proximity time is started, eventhough other fingers additionally move close to the first manipulationsurface and deviate from the proximity detection distance rangethereafter, while at least one finger is close thereto in a state wherethe finger is not in touch with the first manipulation surface, thecontrol section 20 continues to measure the proximity time.

Further, if the measurement of the proximity time is terminated beforethe proximity time reaches the continuous manipulation detection time,at this time, the control section 20 determines that the proximitymanipulation is not performed for the first manipulation surface.

On the other hand, if the measured proximity time reaches the continuousmanipulation detection time, the control section 20 determines whetherall movement traces which are continuously detected thus far fall withina range of the circle of a predetermined radius centering on thecorresponding starting point (center position), for example.

Further, the range of the circle centering on the starting point is usedfor detecting whether the proximity manipulation is performed.Hereinafter, the range of the circle is referred to as a “proximitymanipulation detection range”. Further, the radius of the proximitymanipulation detection range is determined in advance as a predeterminedlength which is equal to or shorter than 1 [mm], for example.

As a result, when the proximity time reaches the continuous manipulationdetection time, if all the movement traces detected thus far extendoutside the proximity manipulation detection range from thecorresponding starting point, the control section 20 determines that theproximity manipulation is not performed for the first manipulationsurface.

That is, even though the finger is not in touch with the firstmanipulation surface at all at the continuous manipulation detectiontime, if one or plural fingers are significantly displaced in positions,the control section 20 determines that the finger mistakenly moves closeto the first manipulation surface and the proximity manipulation is notperformed.

On the other hand, if at least one movement trace falls within thecorresponding proximity manipulation detection range when the proximitytime reaches the continuous manipulation detection time, the controlsection 20 determines that the continuous proximity manipulation as theproximity manipulation is performed for the first manipulation surface.

That is, if it is detected that the finger which is an example of themanipulation body is not in touch with the first manipulation surfaceand one or plural fingers barely change positions and is close to thefirst manipulation surface at the continuous manipulation detectiontime, the control section 20 determines that the continuous proximitymanipulation is performed.

Thus, the control section 20 can obviously distinguish the continuousproximity manipulation from the touch manipulation such as a tapmanipulation or a sliding manipulation and can detect that thecontinuous proximity manipulation is performed for the firstmanipulation surface.

Further, if it is detected that the continuous proximity manipulation isperformed in this way, the control section 20 determines that all theproximity areas detected at the detection time (hereinafter, the timewhen it is detected that the continuous proximity manipulation isperformed is referred to as “continuous manipulation detection time”)are based on the current proximity manipulation.

Thus, even though the plurality of proximity areas starts to be detectedthrough the plural fingers to be slightly shifted in terms of time untilthe proximity time reaches the continuous manipulation detection time,the control section 20 can detect the plurality of proximity areas asproximity areas by means of one proximity manipulation at the continuousmanipulation detection time.

In this way, the control section 20 can detect that the continuousproximity manipulation is performed for the first manipulation surface,and can detect the indication region indicated by the continuousproximity manipulation in the first manipulation surface, on the basisof all the proximity areas detected at the continuous manipulationdetection time.

In a case where the detection method concerning whether such acontinuous proximity manipulation is performed is applied to theabove-described display control process routine RT1, if a positiveresult is obtained in step SP1, the control section 20 startsmeasurement of the proximity time and detection of the movement trace ofthe manipulation body, and then moves the routine to step SP7.

Further, in step SP7, the control section 20 determines whether theproximity time reaches the proximity manipulation detection time in astate where at least one movement trace of the manipulation body iswithin the proximity manipulation detection range.

At this time, if a negative result is obtained in step SP7, this meansthat there is a possibility that the manipulation body mistakenly movesclose to one of the first manipulation surface and the secondmanipulation surface or moves close to one of the first manipulationsurface and the second manipulation surface for the touch manipulation.

Here, at this time, such a negative result merely means that if themanipulation body moves close to approximately the same position in oneof the first manipulation surface and the second manipulation surface,the proximity time does not reach the continuous manipulation detectiontime. Accordingly, if a negative result is obtained in step SP7, thecontrol section 20 returns the routine to step SP1.

Thus, while the manipulation body moves close to approximately the sameposition in one of the first manipulation surface and the secondmanipulation surface, the control section 20 sequentially repeatedlyperforms the processes of step SP1 and step SP7, and waits until theproximity time reaches the continuous manipulation detection time.

In this way, in a case where such a detection method is applied to theabove-described display control process routine RT1, the control section20 can also detect that the continuous proximity manipulation isperformed for one of the first manipulation surface and the secondmanipulation surface.

2-8. Eighth Modified Embodiment

Further, in the above-described embodiment, if one touch area isdetected as a touch area at the time when the touch is started in astate where the touch area is not detected at all, it is determined thatthe touch manipulation is started to detect whether the touchmanipulation is performed.

However, the present invention is not limited thereto. For example, ifone touch area is detected as a touch area at the time when the touch isstarted in a state where the touch area is not detected, it may bedetected that the touch manipulation is performed according to thedetection situation of the touch area thereafter, without determiningthe start of the touch manipulation.

Further, hereinafter, with respect to the detection method concerningwhether such a touch manipulation is performed, a case where themanipulation body is close to the first manipulation surface of thefirst touch panel 14B will be described as an example.

That is, if one touch area is detected as a touch area at the time whenthe touch of the manipulation body is started in a state where the toucharea is not detected at all, the control section 20 starts measurementof the touch time by the timer.

The control section 20 measures the touch time, from the time when thetouch area is detected when the touch of the manipulation body isstarted, to the time when the touch area is detected when the touch ofthe manipulation body is terminated (from the time when the manipulationbody is in touch with the first manipulation surface (the touch isstarted) to the time when the manipulation body is disengaged therefrom(the touch is terminated)). Further, during the measurement of the touchtime, the control section 20 compares the touch time with the tapdetection time.

Further, if one touch area is detected when the touch of themanipulation body is started in this way, the control section 20 alsostarts detection of the movement trace of the manipulation body usingthe center position of one touch area at the time when the touch isstarted as a starting point.

Further, if the detection of the movement trace of the manipulation bodyis started, whenever the control section 20 performs the area detectionprocess thereafter to detect the touch area of the manipulation body andits center position to be traced, the control section 20 sequentiallytraces the detected center position from the starting point, to therebydetect the movement trace of the manipulation body.

Further, if the manipulation body is disengaged from the firstmanipulation surface and the measurement of the touch time is terminatedbefore the touch time reaches the tap detection time, the controlsection 20 determines whether the movement trace detected thus far fallswithin the type detection circle centering on the starting point (centerposition).

As a result, if the movement trace which ranges from the time when thetouch of the manipulation body for the first manipulation surface isstarted to the time when the touch thereof is terminated falls withinthe type detection circle, at this time, the control section 20determines that the tap manipulation is performed as the touchmanipulation for the first manipulation surface.

At this time, the control section 20 uses the center position (that is,the center position indicated by the coordinates of the pixel position)of the touch area at the time when the touch of the manipulation bodythrough the tap manipulation is terminated, as a tap indication positionindicated by the tap manipulation in an image displayed on the displaysurface of the first liquid crystal display panel 14A at this time.

Further, if the movement trace of the manipulation body disengaged fromthe first manipulation surface before the touch time reaches the tapdetection time extends outside the type detection circle, at this time,the control section 20 determines that the tap manipulation as the touchmanipulation is not performed on the first manipulation surface.

Further, if the touch time measured by the timer is beyond the tapdetection time, the control section 20 determines whether the movementtrace of the manipulation body extends outside the type detectioncircle.

As a result, if it is detected that the touch time is beyond the tapdetection time and the movement trace of the manipulation body which isin touch with the first manipulation surface extends outside the typedetection circle, at this time, the control section 20 determines thatthe sliding manipulation as the touch manipulation is performed on thefirst manipulation surface.

In this case, until the sliding manipulation is terminated after thesliding manipulation detection time, the control section 20 sequentiallyupdates the movement trace of the manipulation body according to thedetection of the center position. Further, the control section 20 usesthe movement trace of the manipulation body through the slidingmanipulation for image scrolling, for example.

Further, if the manipulation body is disengaged from the firstmanipulation surface in a state where the touch time is beyond the tapdetection time and the movement trace of the manipulation body which isin touch with the first manipulation surface falls within the typedetection circle, at this time, the control section 20 determines thatthe manipulation body is mistakenly in touch with the first manipulationsurface and the touch manipulation is not performed.

In this way, the control section 20 can detect that the tap manipulationis performed using one finger which is an example of the manipulationbody on the first manipulation surface of the first touch panel 14B,with such a detection method.

Further, the control section 20 can also detect that the slidingmanipulation is performed using one finger which is the example of themanipulation body on the first manipulation surface of the first touchpanel 14B.

2-9. Ninth Modified Embodiment

Further, in the above-described embodiment, the display controlapparatus according to the present invention is applied to the mobileterminal 10 as described above with reference to FIGS. 1 to 23.

However, the present invention is not limited thereto. For example, thedisplay control apparatus may be applied to a computer in which a touchpanel and a display section such as a liquid crystal display panel areinstalled, or to an information processing apparatus such as a mobilephone, PDA (personal digital assistant), portable game player or thelike.

Further, the present invention can be widely applied to a displaycontrol apparatus having a variety of configurations, for example, aphotographing apparatus such as a digital still camera or digital videocamera, a portable reproduction apparatus or the like.

2-10. Tenth Modified Embodiment

Further, in the above-described embodiment, a display control programaccording to the present invention is applied to the display controlprogram stored in advance in the non-volatile memory 21 as describedabove with reference to FIGS. 1 to 23.

Further, the control section 20 performs the display control processroutine RT1 as described above with reference to FIGS. 21 and 22according to the display control program.

However, the present invention is not limited thereto. For example, themobile terminal 10 may be installed with the display control program bya computer-readable storage medium in which the display control programis stored.

Further, the control section 20 may perform the display control processroutine RT1 according to the installed display control program.

Further, the mobile terminal 10 may be installed with the displaycontrol program from the outside using a wired or wireless communicationmedium such as a local area network, the internet, digital satellitebroadcasting or the like.

Further, the computer-readable storage medium for installing the displaycontrol program in the mobile terminal 10 to be in a performable statemay be realized as a package media such as a flexible disc.

Further, the computer-readable storage medium for installing the displaycontrol program in the mobile terminal 10 to be in a performable statemay be realized as a package media such as a CD-ROM (compact disc-readonly memory).

Furthermore, the computer-readable storage medium for installing thedisplay control program in the mobile terminal 10 to be in a performablestate may be realized as a package media such as a DVD (digitalversatile disc) or the like.

Further, the computer-readable storage medium may be realized as asemiconductor memory, a magnetic disk or the like in which a variety ofprograms is temporarily or permanently stored, in addition to thepackage media.

Further, as a means for storing the display control program in thecomputer-readable storage medium, a wired or wireless communicationmedium such as a local area network, the Internet, digital satellitebroadcasting may be used.

Further, the display control program may be stored in thecomputer-readable storage medium through a variety of communicationinterfaces such as a router, modem or the like.

2-11. Eleventh Modified Embodiment

Further, in the above-described embodiment, the first liquid crystaldisplay panel 14A and the second liquid crystal display panel 15A, asdescribed above with reference to FIGS. 1 to 23, are used as the displaysection.

However, the present invention is not limited thereto. For example, adisplay section having a variety of configurations such as an organic EL(electro luminescence) display, a cathode-ray tube or the like, may bewidely used as the display section.

2-12. Twelfth Modified Embodiment

Further, in the above-described embodiment, the electrostaticcapacitance type of first touch panel 14B and second touch panel 15B, asdescribed above with reference to FIGS. 1 to 23, are used as thedetecting section for detecting the indication manipulation for themanipulation surface.

However, the present invention is not limited thereto. For example, adisplay section including a touch panel of an electrostatic capacitancetype or a touch panel of a pressure-sensitive type which is installedintegrally or separately to the display section may be used as thedetecting section.

Further, in the above-described embodiment, a detecting section having avariety of configurations such as a touch screen formed by arranging aninfrared emitting element and infrared sensing element for detecting thetouch and proximity of the manipulation body in each pixel position ofthe liquid crystal display panel may be widely used as the detectingsection.

2-13. Thirteenth Modified Embodiment

Further, in the above-described embodiment, the control section 20including the CPU, as described above with reference to FIGS. 1 to 23,is used as a detecting section for detecting, if the indicationmanipulation for the manipulation surface is detected by the detectingsection, the area indicated through the indication manipulation in themanipulation surface, and enlarging the image on the basis of thedetected area to be displayed on the display section.

However, the present invention is not limited thereto. For example, asthe detecting section, a microprocessor or a DSP (digital signalprocessor) may be used.

Further, in the present invention, as the detecting section, a controlsection having a variety of configurations such as a control circuithaving a hardware circuit configuration for detecting, if the indicationmanipulation for the manipulation surface is detected by the detectingsection, the area indicated through the indication manipulation in themanipulation surface, and enlarging the image on the basis of thedetected area to be displayed on the display section, may be widelyused.

2-14. Fourteenth Modified Embodiment

Further, in the above-described embodiment, the first liquid crystaldisplay panel 14A and the second liquid crystal display panel 15A, asdescribed above with reference to FIG. 1 to FIG. 23, are used as theoriginal image display section for displaying an image.

However, the present invention is not limited thereto. For example, adisplay section having a variety of configurations such as an organic ELdisplay, a cathode-ray tube or the like, may be widely used as thedisplay section.

2-15. Fifteenth Modified Embodiment

Further, in the above-described embodiment, the liquid crystal displaypanel 14A and the second liquid crystal display panel 15A, as describedabove with reference to FIG. 1 to FIG. 23, are used as the enlargedimage display section for displaying the enlarged image obtained byenlarging part of the image.

However, the present invention is not limited thereto. For example, adisplay section having a variety of configurations such as an organic ELdisplay, a cathode-ray tube or the like, may be widely used as thedisplay section.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

What is claimed is:
 1. An information processing apparatus comprising: adisplay; a touch sensor; and at least one processor configured to detecta user operation to a manipulation area of the touch sensor and a numberof fingers associated with the user operation, determine a relativescale of a target area of the display based on the number of fingers,and control to display, upon the display, the target area at therelative scale, wherein the target area is displayed at a smallerrelative scale when a greater number of fingers are detected, andwherein the target area and the manipulation area are not overlapped. 2.The information processing apparatus according to claim 1, furthercomprising: a network interface configured to receive data from a serveron a network.
 3. The information processing apparatus according to claim2, wherein the data comprises web page data.
 4. The informationprocessing apparatus according to claim 3, wherein the at least oneprocessor controls to display, within the target area, a page imageassociated with the web page data.
 5. The information processingapparatus according to claim 1, wherein the at least one processorcontrols to display, within the target area, a web page via a webbrowser application.
 6. The information processing apparatus accordingto claim 5, wherein a relative scale of the web page is changed based onthe user operation.
 7. The information processing apparatus according toclaim 5, wherein the web page is scrolled based on the user operation.8. The information processing apparatus according to claim 1, furthercomprising: a proximity sensor configured to detect a proximity of oneor more fingers associated with the user operation.
 9. The informationprocessing apparatus according to claim 1, further comprising: a seconddisplay, wherein the touch sensor is arranged in conjunction with asurface of the second display.
 10. The information processing apparatusaccording to claim 1, wherein the second display is provided adjacent tothe display.
 11. The information processing apparatus according to claim1, wherein the touch sensor is an electrostatic capacitance-type touchpanel.
 12. An information processing apparatus comprising: at least oneprocessor configured to detect a user operation to a manipulation areaof a touch sensor and a number of fingers associated with the useroperation, determine a relative scale of a target area of the displaybased on the number of fingers, and control to display the target areaat the relative scale, wherein the target area is displayed at a smallerrelative scale when a greater number of fingers are detected, andwherein the target area and the manipulation area are not overlapped.13. The information processing apparatus according to claim 12, furthercomprising: a proximity sensor configured to detect a proximity of oneor more fingers associated with the user operation.
 14. The informationprocessing apparatus according to claim 12, further comprising: a firstdisplay upon which the target area is displayed; and a second display inconjunction with which the touch sensor is arranged.
 15. The informationprocessing apparatus according to claim 14, wherein the second displayis provided adjacent to the first display.
 16. The informationprocessing apparatus according to claim 12, wherein the user operationis electrostatically detected by an electrostatic capacitance-type touchpanel having the touch sensor.
 17. An information processing methodcomprising: detecting a user operation to a manipulation area of a touchsensor and a number of fingers associated with the user operation;determining a relative scale of a target area of the display based onthe number of fingers; and displaying the target area at the relativescale, wherein the target area is displayed at a smaller relative scalewhen a greater number of fingers are detected, and wherein the targetarea and the manipulation area are not overlapped.
 18. A non-transitorycomputer-readable medium having embodied thereon a program, which whenexecuted by a computer causes the computer to execute a method, themethod comprising: detecting a user operation to a manipulation area ofa touch sensor and a number of fingers associated with the useroperation; determining a relative scale of a target area of the displaybased on the number of fingers; and displaying the target area at therelative scale, wherein the target area is displayed at a smallerrelative scale when a greater number of fingers are detected, andwherein the target area and the manipulation area are not overlapped.